-- Logs begin at Sat 2022-06-18 07:25:12 UTC, end at Sat 2022-06-18 08:27:56 UTC. -- Jun 18 07:58:33.971334 dv-cinder-826349-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 07:58:33.980143 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 07:58:33 2022] *** Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: nodename: dv-cinder-826349-2-iscsi Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: machine: x86_64 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: clock source: unix Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: pcre jit disabled Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: detected number of CPU cores: 4 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: current working directory: / Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: detected binary path: /usr/bin/uwsgi-core Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: your processes number limit is 47680 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: your memory page size is 4096 bytes Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: detected max file descriptor number: 2048 Jun 18 07:58:33.982044 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: lock engine: pthread robust mutexes Jun 18 07:58:33.982880 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: thunder lock: enabled Jun 18 07:58:33.982880 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 07:58:33.982880 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 07:58:34.024856 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: Python main interpreter initialized at 0x55fc4a0959c0 Jun 18 07:58:34.024856 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: python threads support enabled Jun 18 07:58:34.024856 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: your server socket listen backlog is limited to 100 connections Jun 18 07:58:34.024856 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: your mercy for graceful operations on workers is 90 seconds Jun 18 07:58:34.025306 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 07:58:34.025306 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: *** Operational MODE: preforking *** Jun 18 07:58:34.025559 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: *** uWSGI is running in multiple interpreter mode *** Jun 18 07:58:34.025559 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: spawned uWSGI master process (pid: 103239) Jun 18 07:58:34.025758 dv-cinder-826349-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 18 07:58:34.026765 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: spawned uWSGI worker 1 (pid: 103240, cores: 1) Jun 18 07:58:34.026765 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: spawned uWSGI worker 2 (pid: 103241, cores: 1) Jun 18 07:58:34.026765 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 07:58:34.666552 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 07:58:34.667173 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 07:58:35.762540 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 07:58:35.762540 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: from cryptography.utils import int_from_bytes Jun 18 07:58:35.763237 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 07:58:35.763237 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: from cryptography.utils import int_from_bytes Jun 18 07:58:35.766733 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 07:58:35.766733 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes Jun 18 07:58:35.767226 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 07:58:35.767226 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes Jun 18 07:58:38.310137 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 07:58:38.310858 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 07:58:38.310964 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 07:58:38.310964 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 07:58:38.311403 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 07:58:38.311403 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 07:58:38.311561 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 07:58:38.311649 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 07:58:38.311730 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 07:58:38.311807 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.311957 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 07:58:38.312097 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.312335 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.312485 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.312620 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.312709 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.312974 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313111 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313289 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313385 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313599 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313733 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.313885 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314000 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314217 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314349 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314437 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314526 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314760 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.314908 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.315106 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826349-2-iscsi {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.315238 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.315410 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.315541 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.315681 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316140 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826349-2-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316386 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316597 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316688 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316778 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.316968 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317068 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317289 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317436 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317723 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.317912 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.318057 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.318161 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.318671 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.318809 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.318978 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319119 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319297 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319389 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319596 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319716 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.319947 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320116 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320269 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320415 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320547 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320642 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320838 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.320935 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321138 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321264 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321455 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321554 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321759 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.321933 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826349-2-iscsi {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322200 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826349-2-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322299 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322514 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322604 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322818 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.322939 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323159 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323252 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323538 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323639 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323850 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.323946 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324149 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324248 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324462 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324558 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324758 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.324856 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325066 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325155 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325371 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325459 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325682 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325773 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.325990 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326079 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326284 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326380 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326584 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326686 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326866 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.326952 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327194 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327295 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327498 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327591 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327793 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.327888 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328034 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328120 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328320 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328419 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328624 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328719 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.328930 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329020 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329241 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329329 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329555 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329657 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329801 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.329886 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330046 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330134 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330360 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330459 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330683 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330768 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.330988 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331195 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331315 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331402 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331611 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331702 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.331910 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332005 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332208 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332292 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332503 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332597 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332802 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.332905 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333101 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333185 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333408 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333493 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333715 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.333815 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334017 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334101 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334319 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334403 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334633 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334726 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.334933 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335036 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335258 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335358 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335584 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335671 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335891 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.335974 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336191 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336282 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336501 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336594 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336814 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.336913 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337114 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337210 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337433 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337520 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337733 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.337825 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338036 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338134 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338349 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338437 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338638 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338722 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338882 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.338978 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339202 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339290 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339498 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339592 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339798 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.339893 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340095 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340179 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340390 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340478 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340688 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340781 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.340976 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341062 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341268 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341361 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341560 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341657 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341856 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.341942 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342149 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342246 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342443 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342538 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342735 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.342820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343049 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343138 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343347 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343474 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343641 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343726 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.343939 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344023 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344250 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344336 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344546 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344636 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344840 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.344934 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345137 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345232 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345433 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345533 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345733 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.345817 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346027 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346121 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346325 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346411 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346628 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346713 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.346920 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347038 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347242 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347329 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347539 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347622 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347834 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.347918 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348131 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348227 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348430 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348517 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348725 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.348809 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349019 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349103 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349315 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349418 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349611 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349702 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.349906 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350002 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350198 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350297 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350491 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350576 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350784 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.350874 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351097 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351199 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351392 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351478 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351685 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351769 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.351991 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352087 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352265 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352350 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352577 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352661 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352873 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.352958 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353218 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353317 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353520 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353640 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353814 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.353914 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.354128 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 07:58:38.354226 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.354453 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.354548 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.354777 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.354874 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355103 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355216 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355426 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355538 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355748 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.355843 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356057 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356152 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356359 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356463 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356666 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356764 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.356973 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357069 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357273 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357378 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357575 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357669 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357878 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.357972 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358187 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358293 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358494 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358599 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358805 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.358916 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359133 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359236 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359450 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359537 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359755 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.359841 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360059 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360160 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360363 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360458 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360678 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360771 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.360986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361073 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361289 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361384 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361593 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361685 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.361929 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362024 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362229 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362322 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362547 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362636 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362862 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.362957 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363191 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363280 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363494 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363636 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363803 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.363908 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364110 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364207 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364427 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364533 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364728 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.364832 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365038 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365134 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365343 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365453 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365646 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365741 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.365945 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366039 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366246 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366351 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366550 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366648 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366857 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.366951 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367196 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367305 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367502 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367598 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367805 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.367909 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368109 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368217 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368409 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368497 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368733 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.368828 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369037 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369130 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369335 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369422 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369630 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369716 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.369923 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370010 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370221 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370314 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370514 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370599 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370811 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.370898 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371149 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371241 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371447 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371546 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371765 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.371852 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372059 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372144 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372361 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372461 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372663 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372751 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.372966 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373051 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373260 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373353 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373559 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373665 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373865 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.373963 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374159 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374256 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374456 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374551 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374759 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.374844 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375085 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375187 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375391 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375478 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375689 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375774 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.375986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376087 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376284 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376370 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376582 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376669 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376892 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.376994 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377184 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377277 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377483 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377568 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377786 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.377873 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378092 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378178 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378394 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378480 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378701 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.378789 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379042 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379131 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379345 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379450 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379656 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379756 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.379969 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380054 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380280 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380376 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380576 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380662 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380877 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.380964 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381171 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381270 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381467 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381553 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381759 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.381846 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382057 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382151 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382351 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382437 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382648 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382742 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.382944 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383053 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383270 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383361 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383567 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383652 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.383873 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384009 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384175 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384265 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384548 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384639 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384843 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.384930 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385140 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385226 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385440 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385527 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385757 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.385852 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386062 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386157 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386399 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386493 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386713 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.386799 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387064 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387157 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387355 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387454 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387663 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387751 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.387967 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388053 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388272 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388373 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388573 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388662 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388875 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.388964 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389181 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389277 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389483 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389576 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389790 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.389875 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390090 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390184 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390397 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390483 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390697 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.390782 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391020 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391109 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391328 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391427 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391634 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391722 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.391943 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392044 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392275 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392365 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392586 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392674 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392901 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.392991 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393204 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393290 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393508 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393594 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393815 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.393909 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394121 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394248 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394424 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394538 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394724 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.394833 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395051 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395152 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395357 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395453 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395665 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395750 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.395964 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396058 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396271 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396366 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396571 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396665 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396882 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.396968 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397179 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397279 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397479 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397791 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.397885 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398110 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398208 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398409 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398497 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398711 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.398801 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399035 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399139 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399345 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399430 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399647 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399735 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.399976 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400070 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400276 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400362 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400572 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400659 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400874 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.400965 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401176 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401262 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401477 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401573 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401779 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.401873 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402074 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402174 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402374 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402469 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402672 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402758 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.402970 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403076 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403291 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403396 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403588 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403682 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403896 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.403984 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404199 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404319 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404506 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404602 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404813 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.404905 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405111 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405216 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405409 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405503 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405708 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.405810 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406007 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406109 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406304 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406398 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406600 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406695 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406893 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.406988 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407215 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407309 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407544 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407637 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407840 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.407934 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408138 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408240 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408446 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408539 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408747 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.408842 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409052 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409146 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409350 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409453 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409652 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409747 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.409956 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410048 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410258 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410360 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410559 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410653 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410861 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.410954 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411188 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411296 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411492 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411591 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411796 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.411889 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412103 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412372 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412459 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412537 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412689 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412777 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.412988 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413078 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413282 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413370 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413582 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413678 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413887 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.413984 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.414215 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.414446 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.414762 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.414862 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415090 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415180 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415403 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415490 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415786 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.415890 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416096 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416183 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416410 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416495 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416726 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.416821 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417049 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417141 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417436 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417641 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417736 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.417939 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418026 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418235 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418323 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418533 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418618 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418827 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.418914 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419149 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419240 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419449 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419536 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419745 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.419840 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420038 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420124 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420334 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420419 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420626 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420730 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.420921 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421007 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421220 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421306 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421511 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421605 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421813 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.421898 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422104 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422188 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422403 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422498 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422699 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422784 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.422992 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423106 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423310 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423398 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423604 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423690 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423901 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.423994 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424220 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424306 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424523 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424620 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424851 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.424937 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425173 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425258 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425464 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425548 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425758 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.425862 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426069 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426156 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426362 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426447 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426658 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426764 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.426949 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427142 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427298 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427392 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427597 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427691 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427890 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.427977 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428185 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428270 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428482 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428585 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428782 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.428868 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429082 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429187 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429374 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429471 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429671 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429763 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.429963 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430047 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430260 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430347 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430569 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430657 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430871 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.430965 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431222 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431312 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431523 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431609 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431826 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.431910 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432122 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432217 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432418 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432503 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432709 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.432795 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433006 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433092 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433300 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433384 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433598 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433698 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433895 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.433981 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434194 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434280 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434514 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434622 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434771 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.434861 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435102 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435192 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435407 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435577 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435704 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.435799 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436001 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436088 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436300 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436396 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436593 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436677 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436886 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.436980 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437183 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437269 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437488 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437575 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437793 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.437878 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438089 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438176 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438388 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438473 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438682 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438767 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.438980 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439080 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439301 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439386 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439601 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439702 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439897 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.439985 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.440192 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.440277 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.440486 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.440582 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441139 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441237 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441440 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441524 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441738 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.441836 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442047 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442132 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442344 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442431 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442643 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442739 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.442936 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443044 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443257 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443580 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443676 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443879 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.443965 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444215 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444300 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444518 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444623 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444825 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.444920 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445125 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445211 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445430 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445517 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445733 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.445825 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446029 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446114 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446328 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446415 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446627 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446718 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.446987 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447121 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447313 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447400 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447609 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447694 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.447906 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448061 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448209 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448298 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448513 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448598 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.448914 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449130 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449222 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449443 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449535 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449742 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.449842 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450037 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450131 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450336 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450421 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450632 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450729 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.450931 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451038 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451254 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451340 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451555 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451653 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451855 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.451939 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452157 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452244 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452460 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452545 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452759 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.452843 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453056 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453141 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453354 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453447 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453654 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453738 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.453948 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454035 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454246 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454332 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454548 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454640 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454844 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.454946 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455164 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455252 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455459 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455543 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455758 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.455857 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456049 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456134 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456346 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456460 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456763 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.456868 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457149 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457358 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457446 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457655 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457749 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.457952 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458044 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458255 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458339 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458556 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458851 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.458937 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459171 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459269 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459569 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459655 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459870 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.459955 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460169 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460255 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460463 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460552 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460755 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.460849 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461050 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461135 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461355 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461442 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461646 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461730 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.461940 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462026 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462234 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462328 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462556 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462666 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.462872 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463154 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463246 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463482 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463899 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.463983 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464203 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464290 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464500 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464584 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464904 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.464999 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465208 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465293 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465508 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465600 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465828 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.465922 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466142 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466228 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466458 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466544 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466755 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.466866 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467081 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467171 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467386 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467473 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467704 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.467789 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468019 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468116 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468323 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468409 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468627 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468722 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.468925 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469021 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469241 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469385 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469554 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469680 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469859 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.469959 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470169 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470254 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470571 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470665 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470886 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.470973 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471212 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471307 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471524 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471609 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471843 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.471930 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472138 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472243 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472436 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472530 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472737 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.472825 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473121 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473328 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473413 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473641 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473728 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.473936 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474029 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474238 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474414 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474538 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474624 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474840 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.474971 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475161 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475261 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475454 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475548 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475768 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.475853 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476059 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476153 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476459 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476674 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476760 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.476987 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477086 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477303 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477389 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477597 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477682 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.477911 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478007 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478271 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478358 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478662 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478867 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.478954 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479189 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479276 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479523 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479607 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479829 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.479925 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480129 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480215 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480451 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480545 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480768 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.480862 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481069 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481156 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481391 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481487 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481708 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.481804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482016 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482103 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482326 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482426 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482645 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482731 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.482942 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483061 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483265 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483362 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483568 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483660 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483866 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.483952 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484163 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484262 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484458 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484551 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484756 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.484842 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485052 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485138 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485343 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485430 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485640 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485726 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.485954 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486040 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486246 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486331 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486558 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486645 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486862 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.486949 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487188 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487289 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487489 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487581 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487787 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.487876 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488119 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488204 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488414 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488508 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488737 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.488827 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489047 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489133 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489358 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489451 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489679 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489769 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.489981 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490082 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490295 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490395 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490604 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490690 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490911 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.490998 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491246 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491345 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491553 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491638 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491861 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.491953 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492168 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492255 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492475 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492560 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492773 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.492858 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493082 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493170 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493389 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493475 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493723 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.493808 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494234 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494330 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494559 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494644 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494863 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.494949 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495194 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495285 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495501 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495598 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495807 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.495901 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496111 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496198 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496414 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496499 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496717 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.496817 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497021 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497106 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497318 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497404 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497639 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497734 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.497954 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498053 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498274 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498367 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498600 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498721 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498910 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.498996 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499247 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499333 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499555 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499676 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499863 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.499980 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500209 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500308 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500514 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500613 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500814 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.500907 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501120 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501215 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501428 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501515 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501730 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.501823 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502034 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502132 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502332 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502416 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502637 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502723 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.502944 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503100 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503273 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503359 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503579 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503664 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503882 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.503969 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504190 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504277 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504505 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504591 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504831 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.504927 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505142 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505275 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505448 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505548 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505754 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.505841 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506061 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506159 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506570 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506670 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506880 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.506966 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507237 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507325 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507554 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507652 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507874 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.507971 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.508180 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.508265 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.508492 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.508683 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.508805 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509017 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509104 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509394 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509493 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509705 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.509791 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510013 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510146 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510371 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510468 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510673 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510760 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.510982 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511119 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511309 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511408 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511605 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511689 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.511917 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.512002 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.512220 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.512442 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.512743 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.512829 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513079 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513171 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513474 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513709 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.513870 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514010 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514146 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514299 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514439 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514600 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514734 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.514898 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515227 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515387 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515529 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515664 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515824 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.515967 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516122 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516267 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516420 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516553 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516718 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.516860 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517019 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517153 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517318 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517455 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517617 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517758 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.517915 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518048 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518197 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518328 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518512 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518660 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518813 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.518943 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519131 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519219 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519429 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519521 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519728 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.519813 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520022 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520105 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520316 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520414 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520612 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520698 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520907 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.520994 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521202 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521288 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521494 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521586 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521793 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.521878 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522087 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522173 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522388 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522474 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522679 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522773 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.522980 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523099 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523344 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523432 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523658 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523754 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.523959 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524046 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524253 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524341 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524562 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524656 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524881 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.524996 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525247 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525332 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525557 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525655 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525863 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.525957 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.526197 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.526282 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.526501 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.526731 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527044 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527136 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527375 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527461 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527689 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.527778 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528014 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528099 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528315 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528400 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528618 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528706 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.528919 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529055 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529216 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529529 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529615 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529827 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.529921 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530130 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530224 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530432 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530520 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530735 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.530822 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531058 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531159 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531364 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531448 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531666 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531752 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.531970 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532135 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532273 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532359 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532576 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532670 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532879 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.532968 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533173 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533267 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533475 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533562 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533781 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.533869 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534109 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534240 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534455 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534586 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534712 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.534826 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535052 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535167 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535343 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535469 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535644 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535755 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.535945 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536065 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536245 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536365 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536541 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536652 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.536848 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537004 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537165 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537285 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537466 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537578 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537761 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.537879 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.538170 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.538291 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.538474 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.538594 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.538788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539457 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539565 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539654 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539734 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539814 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539814 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.539970 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540056 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540134 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540314 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540438 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540645 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540741 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.540945 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541032 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541268 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541364 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541597 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541687 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.541914 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542001 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542216 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542320 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542549 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542700 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542816 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.542910 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543163 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543296 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543441 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543540 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543772 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.543906 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544074 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544216 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544323 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544408 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544649 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544775 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.544917 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545036 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545239 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545366 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545509 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545831 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.545972 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546100 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546193 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546427 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546566 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546691 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.546790 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547034 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547178 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547313 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547406 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547630 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547756 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547898 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.547991 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548215 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548351 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548485 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548570 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548812 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.548957 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549133 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549240 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549400 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549489 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549659 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549765 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.549977 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550111 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550298 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550456 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550592 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550700 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.550897 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551121 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551223 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551305 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551525 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551624 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551829 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.551924 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552129 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552214 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552442 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552544 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552756 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.552853 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553060 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553143 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553360 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553447 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553677 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553778 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.553980 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554066 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554286 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554391 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554584 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554671 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554887 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.554974 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555211 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555299 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555515 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555603 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555832 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.555920 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556151 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556252 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556506 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556595 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556821 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.556913 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557128 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557223 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557438 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557523 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557744 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.557830 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558048 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558143 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558356 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558450 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558662 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558748 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.558961 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559109 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559291 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559377 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559589 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559682 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559892 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.559982 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560248 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560351 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560503 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560612 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560823 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.560921 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561122 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561210 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561424 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561524 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561741 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.561829 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562057 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562144 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562375 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562460 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562686 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.562773 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563040 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563131 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563352 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563451 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563659 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563743 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.563956 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.564054 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.564199 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 07:58:38.564311 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 07:58:38.564476 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 07:58:38.721367 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Registered counter for database nova_api Jun 18 07:58:38.722578 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Registered counter for database nova_api Jun 18 07:58:38.744672 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.746371 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.751270 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.753792 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.807939 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.context [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45c5db4e-158a-4a75-9b44-9638d16c22a0(cell1) {{(pid=103241) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 07:58:38.811420 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.context [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45c5db4e-158a-4a75-9b44-9638d16c22a0(cell1) {{(pid=103240) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 07:58:38.811848 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 07:58:38.813420 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 07:58:38.814163 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 07:58:38.815342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 07:58:38.816507 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 07:58:38.817327 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 07:58:38.818096 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 07:58:38.818489 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Registered counter for database nova_cell0 Jun 18 07:58:38.820046 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 07:58:38.822133 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Registered counter for database nova_cell0 Jun 18 07:58:38.822526 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Registered counter for database nova_cell1 Jun 18 07:58:38.826240 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Registered counter for database nova_cell1 Jun 18 07:58:38.830612 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.832280 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.834190 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.839196 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.839612 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.840204 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:38.841062 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.983414 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:38.989411 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Registered counter for database nova_cell0 Jun 18 07:58:38.992472 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Registered counter for database nova_cell0 Jun 18 07:58:38.999636 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:39.003501 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 07:58:39.004237 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:39.008512 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 07:58:39.341737 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 07:58:39.342409 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 07:58:39.349151 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 07:58:39.349286 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 07:58:39.687051 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 07:58:39.687300 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 07:58:39.693384 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 07:58:39.693564 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 07:58:39.698650 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc4a0959c0 pid: 103240 (default app) Jun 18 07:58:39.698783 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fc4a0959c0 pid: 103241 (default app) Jun 18 07:58:39.700731 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 07:58:39.701900 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-26a2d2e4-9b52-4159-8e30-27bed7ec1e08 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jun 18 07:58:39.702301 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sat Jun 18 07:58:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 07:59:54.377901 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 07:59:54.379146 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jun 18 07:59:54.379547 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 07:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 07:59:54.395324 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:54.396234 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell0:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:54.397628 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell1:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:54.398642 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:54.827971 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-4b2641de-5297-44c0-b9d1-33646f543a0a admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 07:59:54.856840 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-4b2641de-5297-44c0-b9d1-33646f543a0a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471030 Jun 18 07:59:54.857630 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 07:59:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 07:59:56.904787 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 07:59:56.905785 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-6c97508d-ab18-436d-a1fa-e8e06e04fef5 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 18 07:59:56.906172 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 07:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 07:59:56.966431 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-f3650744-598a-49b0-95e3-c93425b4d909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 07:59:56.986929 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 07:59:56.986929 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: warnings.warn(msg) Jun 18 07:59:57.018323 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-f3650744-598a-49b0-95e3-c93425b4d909 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106152 Jun 18 07:59:57.019381 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 07:59:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 07:59:57.240861 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-68e81a79-6dce-423e-b3fc-be58f291b0db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 07:59:57.243469 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 07:59:57.243469 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 07:59:57.246455 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:57.247570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell1:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:57.248645 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:57.250167 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 07:59:57.318865 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-68e81a79-6dce-423e-b3fc-be58f291b0db admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290738 Jun 18 07:59:57.319869 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 07:59:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 07:59:59.414412 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-f3650744-598a-49b0-95e3-c93425b4d909 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 07:59:59.415472 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-f3650744-598a-49b0-95e3-c93425b4d909 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 18 07:59:59.415839 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 07:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 07:59:59.525965 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c2ba2622-06ee-4f4d-a2b0-496a2066e48a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 07:59:59.543390 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 07:59:59.543390 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 07:59:59.563911 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c2ba2622-06ee-4f4d-a2b0-496a2066e48a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142000 Jun 18 07:59:59.564474 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 07:59:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 07:59:59.576436 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-7819df86-95f0-416b-9dcc-488a502433fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 07:59:59.577942 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 07:59:59.577942 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: warnings.warn(msg) Jun 18 07:59:59.613091 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-7819df86-95f0-416b-9dcc-488a502433fb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040407 Jun 18 07:59:59.615429 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 07:59:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:00:01.672087 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c2ba2622-06ee-4f4d-a2b0-496a2066e48a admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:01.673424 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c2ba2622-06ee-4f4d-a2b0-496a2066e48a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jun 18 08:00:01.674109 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:01.733266 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c96a3b7d-8d0a-45de-8630-f1ae314eefb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "ram": 1024}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:01.753965 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-c96a3b7d-8d0a-45de-8630-f1ae314eefb8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073852 Jun 18 08:00:01.754681 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:01.766777 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a85a8b28-4318-4204-9e8c-c7dbfc1444e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:01.791471 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a85a8b28-4318-4204-9e8c-c7dbfc1444e5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028307 Jun 18 08:00:01.792335 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 08:00:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:03.864916 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c96a3b7d-8d0a-45de-8630-f1ae314eefb8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:03.865925 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-c96a3b7d-8d0a-45de-8630-f1ae314eefb8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 18 08:00:03.866321 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:03.928393 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bda68efe-62ea-4798-a482-96ebcb5d54e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:03.947335 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bda68efe-62ea-4798-a482-96ebcb5d54e8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074937 Jun 18 08:00:03.947884 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:03.959917 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-99800221-9860-4a54-9b5f-6a539c5799b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:03.984463 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-99800221-9860-4a54-9b5f-6a539c5799b4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028413 Jun 18 08:00:03.985021 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 08:00:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:06.049551 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bda68efe-62ea-4798-a482-96ebcb5d54e8 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:06.050558 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bda68efe-62ea-4798-a482-96ebcb5d54e8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 18 08:00:06.050925 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:06.112601 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "name": "ds4G", "vcpus": 4, "swap": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:06.133628 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076908 Jun 18 08:00:06.134181 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:06.146279 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-8d95e28c-6b15-4700-b5d8-0b237953bcb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:06.170699 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-8d95e28c-6b15-4700-b5d8-0b237953bcb4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027941 Jun 18 08:00:06.174832 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1335 bytes} [Sat Jun 18 08:00:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:08.234456 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:08.235556 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Jun 18 08:00:08.236123 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:08.296695 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ef98c7b1-67a8-4209-b90a-e29386db977d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:08.323565 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ef98c7b1-67a8-4209-b90a-e29386db977d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081093 Jun 18 08:00:08.331989 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 08:00:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:10.393158 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:10.394240 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-d615581d-67ae-42bb-867c-00a9f0a89a92 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 18 08:00:10.394663 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:10.482870 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-68235550-1ee4-4559-9688-05d14be90a94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:10.503262 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-68235550-1ee4-4559-9688-05d14be90a94 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.101819 Jun 18 08:00:10.503869 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:10.517118 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a861bbed-9ed2-4834-bc09-e35fac812b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:10.545930 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-a861bbed-9ed2-4834-bc09-e35fac812b96 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031095 Jun 18 08:00:10.545930 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 08:00:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:13.259724 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-68235550-1ee4-4559-9688-05d14be90a94 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:13.260830 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-68235550-1ee4-4559-9688-05d14be90a94 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Jun 18 08:00:13.261249 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:13.327588 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-91cfee64-ac7d-4f6b-afa1-186fe85af7c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:13.348458 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-91cfee64-ac7d-4f6b-afa1-186fe85af7c1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079583 Jun 18 08:00:13.349280 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:13.363180 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-dbbb28ab-a11d-4e50-8690-b562d9df3ccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:13.393085 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-dbbb28ab-a11d-4e50-8690-b562d9df3ccb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035055 Jun 18 08:00:13.393827 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 08:00:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:16.082256 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-91cfee64-ac7d-4f6b-afa1-186fe85af7c1 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:16.083434 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-91cfee64-ac7d-4f6b-afa1-186fe85af7c1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 18 08:00:16.083866 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:16.143205 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-01e19156-0123-48be-b3db-bf874b227f9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:16.161480 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-01e19156-0123-48be-b3db-bf874b227f9f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071738 Jun 18 08:00:16.162042 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 08:00:16.174015 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-f427ed67-96ba-4782-83bf-f888887bd68d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:16.200149 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-f427ed67-96ba-4782-83bf-f888887bd68d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029956 Jun 18 08:00:16.201080 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 08:00:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:18.246153 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-01e19156-0123-48be-b3db-bf874b227f9f admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:18.247187 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-01e19156-0123-48be-b3db-bf874b227f9f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 18 08:00:18.247589 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:18.309080 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-4b1f298c-c55d-47d9-a193-b80117e32e2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "disk": 80, "vcpus": 4}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:18.329873 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-4b1f298c-c55d-47d9-a193-b80117e32e2c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076220 Jun 18 08:00:18.330426 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:18.342979 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bd2089bb-4adb-4d1e-9869-4317e23f7b75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:18.370472 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bd2089bb-4adb-4d1e-9869-4317e23f7b75 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031434 Jun 18 08:00:18.371099 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 08:00:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:00:20.475459 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-4b1f298c-c55d-47d9-a193-b80117e32e2c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:20.476508 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-4b1f298c-c55d-47d9-a193-b80117e32e2c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Jun 18 08:00:20.477160 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:20.558601 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:20.578464 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.095315 Jun 18 08:00:20.579129 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1282 bytes} [Sat Jun 18 08:00:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:20.592224 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c51db09f-abba-4533-843b-7e868ad70c9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:20.615911 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-c51db09f-abba-4533-843b-7e868ad70c9e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027442 Jun 18 08:00:20.616843 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1332 bytes} [Sat Jun 18 08:00:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:00:44.001986 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:44.003440 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Jun 18 08:00:44.004068 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:44.018284 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:00:44.067838 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-42ba129a-703d-48db-8d42-5fdb46ba3894 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:44.085182 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-42ba129a-703d-48db-8d42-5fdb46ba3894 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074740 Jun 18 08:00:44.085744 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 08:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:45.013148 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:45.014164 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-7eab14af-0ccf-4271-93af-f7a5af4ec1b8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 18 08:00:45.014559 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:45.208052 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1079d135-0b89-4c0d-8b6e-87454aaffc7a admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:45.213813 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-1079d135-0b89-4c0d-8b6e-87454aaffc7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1079d135-0b89-4c0d-8b6e-87454aaffc7a admin admin] Request method failure captured: Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Host: 10.222.0.23 Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABirYYs3TVbdG_Aks5fEyP6YMTiZkllvBMstrYFm2yhmKel_FxMlxfvk9muCtK0dpp7lyoyazESZyyZN9qhfR6LAz7C1fdrRaqstn6e9p3w5VZRRzTP2OcmdYFj9H24pzH7O0_4mv9-WhJp14CgPdEKrOsRB6Nkj4H1i-RjwCBiCci6IsA Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Role: admin,reader,member Jun 18 08:00:45.217055 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Roles: admin,reader,member Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User: admin Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: method: > Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: exception: Flavor 42 could not be found. Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: action_args: {'id': '42'} Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:45.218614 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:45.219565 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.221063 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1079d135-0b89-4c0d-8b6e-87454aaffc7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:45.222384 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1079d135-0b89-4c0d-8b6e-87454aaffc7a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069863 Jun 18 08:00:45.222384 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 08:00:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 08:00:45.228438 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c4579768-ae51-4845-b54f-8067d4e709f1 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:45.231393 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:00:45.250840 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c4579768-ae51-4845-b54f-8067d4e709f1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026123 Jun 18 08:00:45.251413 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:45.261346 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-2d604235-ccfc-4c18-a129-b523d7932f78 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:45.284504 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-2d604235-ccfc-4c18-a129-b523d7932f78 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026709 Jun 18 08:00:45.285042 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:45.294511 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bc01d5eb-bc9d-4a98-bc2a-f888b520021f admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:45.300969 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-bc01d5eb-bc9d-4a98-bc2a-f888b520021f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bc01d5eb-bc9d-4a98-bc2a-f888b520021f admin admin] Request method failure captured: Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Host: 10.222.0.23 Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABirYYs3TVbdG_Aks5fEyP6YMTiZkllvBMstrYFm2yhmKel_FxMlxfvk9muCtK0dpp7lyoyazESZyyZN9qhfR6LAz7C1fdrRaqstn6e9p3w5VZRRzTP2OcmdYFj9H24pzH7O0_4mv9-WhJp14CgPdEKrOsRB6Nkj4H1i-RjwCBiCci6IsA Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Role: admin,reader,member Jun 18 08:00:45.304304 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Roles: admin,reader,member Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User: admin Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: method: > Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: exception: Flavor 42 could not be found. Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: action_args: {'id': '42'} Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:45.305804 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:45.306661 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:45.307788 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bc01d5eb-bc9d-4a98-bc2a-f888b520021f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:45.308774 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bc01d5eb-bc9d-4a98-bc2a-f888b520021f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014768 Jun 18 08:00:45.308774 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 08:00:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 08:00:46.112377 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-2d604235-ccfc-4c18-a129-b523d7932f78 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:46.113385 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-2d604235-ccfc-4c18-a129-b523d7932f78 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Jun 18 08:00:46.113805 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:46.316226 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-183563b7-240f-4ec4-b989-05757fd62642 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:46.322289 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-183563b7-240f-4ec4-b989-05757fd62642 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-183563b7-240f-4ec4-b989-05757fd62642 admin admin] Request method failure captured: Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Host: 10.222.0.23 Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABirYYuXB94w10Jbj8yY_3bsDPk22GMdv5Jc29mXkjd3I8mTBOZMRcebr2ppItHdYz2EFa20R-0yKiJOFhN-nHWnzN187xjXOHqT774cdCAmqSA4eFJidNMPlXrVKMlZM9ypwJ99uzYVpCKv1QJkJBNSTdm0Qs3p7aIfko6_aG0hm-YYQw Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Role: admin,reader,member Jun 18 08:00:46.323820 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Roles: admin,reader,member Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User: admin Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: method: > Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: exception: Flavor 84 could not be found. Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: action_args: {'id': '84'} Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:46.325570 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:46.326572 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.328012 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-183563b7-240f-4ec4-b989-05757fd62642 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:46.329266 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-183563b7-240f-4ec4-b989-05757fd62642 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.074889 Jun 18 08:00:46.329266 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 08:00:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 08:00:46.335349 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-7adefff6-537f-40f1-8b9d-17aaee435d30 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:46.349092 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-7adefff6-537f-40f1-8b9d-17aaee435d30 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017543 Jun 18 08:00:46.349618 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:46.359116 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-50b28e8c-1f18-4622-8af4-24e04fac0bb9 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:46.374352 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-50b28e8c-1f18-4622-8af4-24e04fac0bb9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018879 Jun 18 08:00:46.374882 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:00:46.387001 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-11ee19b5-7253-4eb5-8c59-3b0aac870442 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:46.394952 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-11ee19b5-7253-4eb5-8c59-3b0aac870442 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-11ee19b5-7253-4eb5-8c59-3b0aac870442 admin admin] Request method failure captured: Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Host: 10.222.0.23 Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABirYYuXB94w10Jbj8yY_3bsDPk22GMdv5Jc29mXkjd3I8mTBOZMRcebr2ppItHdYz2EFa20R-0yKiJOFhN-nHWnzN187xjXOHqT774cdCAmqSA4eFJidNMPlXrVKMlZM9ypwJ99uzYVpCKv1QJkJBNSTdm0Qs3p7aIfko6_aG0hm-YYQw Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Role: admin,reader,member Jun 18 08:00:46.397388 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Roles: admin,reader,member Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User: admin Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: method: > Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: exception: Flavor 84 could not be found. Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: action_args: {'id': '84'} Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:46.399745 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:46.400986 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:46.402899 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-11ee19b5-7253-4eb5-8c59-3b0aac870442 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:46.404805 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-11ee19b5-7253-4eb5-8c59-3b0aac870442 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017998 Jun 18 08:00:46.404805 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Jun 18 08:00:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 18 08:00:47.231079 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-50b28e8c-1f18-4622-8af4-24e04fac0bb9 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:47.232073 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-50b28e8c-1f18-4622-8af4-24e04fac0bb9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 18 08:00:47.232455 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:47.433846 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-052152bc-f5de-4071-be25-09966c3dc235 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:47.440499 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-052152bc-f5de-4071-be25-09966c3dc235 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-052152bc-f5de-4071-be25-09966c3dc235 admin admin] Request method failure captured: Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Host: 10.222.0.23 Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABirYYvbthu0MINLR_S_8AAckZeGgdrfeGSX-IFn9blaYLPnQKL5jqyn3dInl6oKVjrF3Ozp5T-ST7Dbehs_ZcLZywSeEIL1lmQ2Gqs1kOsZWLNB9vYuCBbxzimBflRXV3XYKnOgCTjzl5IfCTfGuGWPrXXnodliOuh92YLrm1L8WLFkdY Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Role: admin,reader,member Jun 18 08:00:47.441938 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Roles: admin,reader,member Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User: admin Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: method: > Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: exception: Flavor 451 could not be found. Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: action_args: {'id': '451'} Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:47.443342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:47.444342 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.445746 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-052152bc-f5de-4071-be25-09966c3dc235 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:47.446953 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-052152bc-f5de-4071-be25-09966c3dc235 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072157 Jun 18 08:00:47.446953 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:00:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 08:00:47.456528 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ebaa4105-afab-4499-a635-1e94f4c4b379 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:47.475207 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ebaa4105-afab-4499-a635-1e94f4c4b379 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024716 Jun 18 08:00:47.475732 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:47.485306 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:47.499503 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017735 Jun 18 08:00:47.500030 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Jun 18 08:00:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:00:47.509393 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-cc8f649b-67cd-4b7f-852c-a7270abd8b88 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:47.515141 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-cc8f649b-67cd-4b7f-852c-a7270abd8b88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-cc8f649b-67cd-4b7f-852c-a7270abd8b88 admin admin] Request method failure captured: Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Host: 10.222.0.23 Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABirYYvbthu0MINLR_S_8AAckZeGgdrfeGSX-IFn9blaYLPnQKL5jqyn3dInl6oKVjrF3Ozp5T-ST7Dbehs_ZcLZywSeEIL1lmQ2Gqs1kOsZWLNB9vYuCBbxzimBflRXV3XYKnOgCTjzl5IfCTfGuGWPrXXnodliOuh92YLrm1L8WLFkdY Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Role: admin,reader,member Jun 18 08:00:47.516647 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Roles: admin,reader,member Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51d49f403c194b17b3511bb8b268764f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51d49f403c194b17b3511bb8b268764f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 51d49f403c194b17b3511bb8b268764f Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User: admin Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Id: 549852c8e55140b989e5de6169f990e3 Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: method: > Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: exception: Flavor 451 could not be found. Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: action_args: {'id': '451'} Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:00:47.518292 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:47.519373 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 18 08:00:47.520649 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-cc8f649b-67cd-4b7f-852c-a7270abd8b88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:00:47.521974 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-cc8f649b-67cd-4b7f-852c-a7270abd8b88 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012173 Jun 18 08:00:47.521974 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:00:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 08:00:48.334417 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:48.335554 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 18 08:00:48.335944 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:48.534453 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a70aca6e-336f-4289-b10f-2e60f3e75f6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:48.558318 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a70aca6e-336f-4289-b10f-2e60f3e75f6e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086982 Jun 18 08:00:48.558831 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 08:00:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:49.394036 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:49.395056 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jun 18 08:00:49.395521 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:49.601146 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-6a240e3c-b0a3-4dde-b0d5-8f43c9c53307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:49.620538 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-6a240e3c-b0a3-4dde-b0d5-8f43c9c53307 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.083895 Jun 18 08:00:49.621049 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 08:00:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:50.443193 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:50.444202 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 18 08:00:50.444606 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:50.651686 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-182818b7-407f-4c1d-b601-573d2b8fe5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:50.671665 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-182818b7-407f-4c1d-b601-573d2b8fe5c7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.090224 Jun 18 08:00:50.672194 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 08:00:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:00:51.498483 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:51.499538 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 18 08:00:51.499927 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:51.690817 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-b3fd93fe-b9d7-43d6-a6a1-25cb99e5fd41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:00:51.719151 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-b3fd93fe-b9d7-43d6-a6a1-25cb99e5fd41 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083673 Jun 18 08:00:51.719751 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Jun 18 08:00:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 08:00:52.536734 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:52.537739 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 18 08:00:52.538118 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:00:52.739793 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-61de9bb3-fba9-4b78-9b3e-07aa6352b283 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:00:52.759222 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-61de9bb3-fba9-4b78-9b3e-07aa6352b283 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084540 Jun 18 08:00:52.759680 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sat Jun 18 08:00:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:01:39.243548 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.245159 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1a3bab19-ad35-4554-848a-e4d4b97065f8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Jun 18 08:01:39.245807 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 930 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:01:39.260167 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:01:39.313379 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-12c52fc1-fbe6-4c02-a953-4f875e989a79 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.333565 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-12c52fc1-fbe6-4c02-a953-4f875e989a79 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081389 Jun 18 08:01:39.334156 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1291 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:01:39.374303 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-e67b257b-f24b-4569-b357-360d31a8ca57 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.379422 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=14 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:01:39.388756 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-e67b257b-f24b-4569-b357-360d31a8ca57 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019450 Jun 18 08:01:39.389618 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:01:39.401641 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-e4e827f7-b4a3-46a4-a0d9-960beef6f1eb admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.409893 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-e4e827f7-b4a3-46a4-a0d9-960beef6f1eb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011773 Jun 18 08:01:39.410435 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:01:39.425721 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.434326 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015094 Jun 18 08:01:39.434841 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1285 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:01:39.446412 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ec9419e7-43c4-4bcd-ae35-5e6c49d361a7 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:01:39.454611 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ec9419e7-43c4-4bcd-ae35-5e6c49d361a7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011687 Jun 18 08:01:39.455137 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1282 bytes} [Sat Jun 18 08:01:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:04:48.889753 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:04:48.890759 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 18 08:04:48.891160 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:04:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:04:49.031928 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=6 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:04:49.165608 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:04:49.166893 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 08:04:49.166893 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 08:04:49.168160 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:04:49.168590 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:04:49.169352 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:04:49.169767 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:04:49.204418 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-910c4217-53c3-46bf-9aa6-12a12c306cfb admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.175094 Jun 18 08:04:49.204973 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:04:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:04:50.031672 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:04:50.032681 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 18 08:04:50.033072 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:04:50.237869 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:04:50.238987 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 08:04:50.238987 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 08:04:50.240208 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:04:50.240686 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:04:50.241472 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:04:50.241890 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:04:50.261441 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-09392129-8c77-4991-a9ff-1502701f65e6 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087642 Jun 18 08:04:50.261974 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:04:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:05:01.531077 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:05:01.532427 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Jun 18 08:05:01.532902 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:05:01.680121 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:05:01.681213 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell1:SELECT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:05:01.682266 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=8 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:05:01.741413 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:05:01.743294 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 08:05:01.743294 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 08:05:01.745044 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:05:01.745672 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:05:01.746774 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:05:01.747456 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:05:01.775269 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-826dd96a-2ccc-4367-b91c-2aa2722e9443 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.102686 Jun 18 08:05:01.775800 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:05:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:05:02.608609 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:05:02.609642 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-05578e5c-3488-4ded-b49b-a49bd371eb3c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 18 08:05:02.610027 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Jun 18 08:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:05:02.798502 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:05:02.799704 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 08:05:02.799704 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 18 08:05:02.801118 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:05:02.801729 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:05:02.802891 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:05:02.803507 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:05:02.825731 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-d462969d-9229-41e0-96ed-560603b4429e admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079097 Jun 18 08:05:02.826272 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Jun 18 08:05:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:05:57.295479 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: Sat Jun 18 08:05:57 2022 - graceful shutdown triggered... Jun 18 08:05:57.295995 dv-cinder-826349-2-iscsi devstack@n-api.service[103240]: Gracefully killing worker 1 (pid: 103240)... Jun 18 08:05:57.295605 dv-cinder-826349-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 18 08:05:57.296802 dv-cinder-826349-2-iscsi devstack@n-api.service[103241]: Gracefully killing worker 2 (pid: 103241)... Jun 18 08:05:58.296319 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: worker 1 buried after 1 seconds Jun 18 08:05:58.296319 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: worker 2 buried after 1 seconds Jun 18 08:05:58.296319 dv-cinder-826349-2-iscsi devstack@n-api.service[103239]: goodbye to uWSGI. Jun 18 08:05:58.298809 dv-cinder-826349-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 18 08:05:58.299749 dv-cinder-826349-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 18 08:05:58.306949 dv-cinder-826349-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 08:05:58.317148 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 08:05:58 2022] *** Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: nodename: dv-cinder-826349-2-iscsi Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: machine: x86_64 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: clock source: unix Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: pcre jit disabled Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: detected number of CPU cores: 4 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: current working directory: / Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: detected binary path: /usr/bin/uwsgi-core Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: your processes number limit is 47680 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: your memory page size is 4096 bytes Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: detected max file descriptor number: 2048 Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: lock engine: pthread robust mutexes Jun 18 08:05:58.319477 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: thunder lock: enabled Jun 18 08:05:58.320564 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 08:05:58.320564 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 08:05:58.366279 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: Python main interpreter initialized at 0x55990ffbf9c0 Jun 18 08:05:58.366279 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: python threads support enabled Jun 18 08:05:58.366279 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: your server socket listen backlog is limited to 100 connections Jun 18 08:05:58.366279 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: your mercy for graceful operations on workers is 90 seconds Jun 18 08:05:58.366796 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 08:05:58.366796 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: *** Operational MODE: preforking *** Jun 18 08:05:58.367038 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: *** uWSGI is running in multiple interpreter mode *** Jun 18 08:05:58.367038 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: spawned uWSGI master process (pid: 117595) Jun 18 08:05:58.367260 dv-cinder-826349-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 18 08:05:58.368504 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: spawned uWSGI worker 1 (pid: 117615, cores: 1) Jun 18 08:05:58.368504 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: spawned uWSGI worker 2 (pid: 117616, cores: 1) Jun 18 08:05:58.368504 dv-cinder-826349-2-iscsi devstack@n-api.service[117595]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 08:05:59.021087 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 08:05:59.024715 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 08:06:00.210873 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 08:06:00.210873 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes Jun 18 08:06:00.211562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 08:06:00.211562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes Jun 18 08:06:00.214525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 08:06:00.214525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes Jun 18 08:06:00.215039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 08:06:00.215039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes Jun 18 08:06:02.601168 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 08:06:02.601784 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 08:06:02.602024 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 08:06:02.602290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 08:06:02.602510 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 08:06:02.602914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.603263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.603579 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.603961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.604262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.604393 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 08:06:02.605472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.605573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 08:06:02.605656 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.605730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 08:06:02.605811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.605811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.605965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 08:06:02.605965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 08:06:02.606126 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606126 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606261 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826349-2-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.606973 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.607967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.608972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.609104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.609389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826349-2-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.609700 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.609802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.609999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610309 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.610918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.611045 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.611261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.611418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.611571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.613303 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.613303 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.613789 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.614053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.614266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.614474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.614697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.614697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.615146 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826349-2-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.615366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.615581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.615798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.616037 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.616254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.616473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.616693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.616898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.617113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.617338 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.617545 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.617761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.617976 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.618191 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.618415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826349-2-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.618627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.618858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619487 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.619857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.620963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621264 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.621910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.622054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.624530 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.624726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.624889 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625036 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625510 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.625956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626280 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.626905 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627278 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627424 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627568 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627710 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.627863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628161 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628459 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.628911 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629514 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629815 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.629967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630120 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.630957 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.631135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.631287 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635790 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.635936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636570 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.636866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637017 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.637828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.638846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639508 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639652 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639652 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.639950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640094 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640242 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640718 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.640870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641020 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.641936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642079 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.642941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643269 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643563 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.643857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644006 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.644892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645042 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645349 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645646 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.645938 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646559 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.646978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647289 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.647907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648522 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.648819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.650261 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.650433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.650588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.650776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.650937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651161 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.651932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652372 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.652947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653105 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653711 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.653862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.657841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658026 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658356 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658518 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.658986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.659236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.659439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.659603 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.659748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.659898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.660934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.661079 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.661235 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.661379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.661541 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.661691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.661845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.661998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.662142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.662287 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.662430 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.662580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.663358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.663520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 08:06:02.663678 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.663842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.663997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664141 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.664881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.665993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.666185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.666398 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.666563 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.666727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.666881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667510 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667653 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.667992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668430 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668729 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.668875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.669026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.669178 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.669321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.669473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.669625 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.670453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.670609 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.670752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.670904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671420 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671728 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.671873 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672026 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672335 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672635 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672778 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.672933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673085 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673378 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673531 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673685 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.673980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674853 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.674995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675327 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.675926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676531 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.676962 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677713 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.677855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678164 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678317 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678468 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678619 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.678916 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.679106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.679490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.679659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.679808 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.680124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.680502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.680744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.680901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681287 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681476 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681645 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681736 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681836 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.681975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682329 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682803 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.682904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683208 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683386 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683850 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.683935 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684032 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684385 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684477 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.684834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685278 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685455 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685548 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685635 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685820 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.685912 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686000 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686252 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686381 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686517 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.686918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687251 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687726 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.687911 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688004 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688190 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688817 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.688984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689075 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689329 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689425 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.689782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690015 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690490 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.690995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691095 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.691984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.692958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693132 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693314 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.693943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.694940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695256 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695630 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695810 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.695910 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696084 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.696966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697230 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697594 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697690 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.697947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698219 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698301 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698471 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698660 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.698950 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699701 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.699961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700704 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.700965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701059 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701652 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701735 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.701993 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702630 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.702940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703500 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703582 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703740 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.703966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704039 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704400 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.704995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705145 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.705919 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706091 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706162 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706245 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706736 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.706955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707594 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.707982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708255 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708421 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708493 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708569 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708640 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.708932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709725 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.709827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710268 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.710934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711868 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.711969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712477 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712570 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.712872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.713850 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714449 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714755 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.714966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.715914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716015 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716306 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.716941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717255 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717487 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717590 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.717897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718506 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718709 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.718799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719323 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719410 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.719928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720018 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720840 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.720937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721756 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.721862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.722950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723302 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723704 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.723988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724498 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.724891 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725096 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725402 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.725806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726009 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726308 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726429 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.726991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727327 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727837 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.727958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728768 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.728908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.729963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.730939 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.731866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732155 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.732968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733660 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.733964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734790 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.734891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735416 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735522 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.735858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736348 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736757 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.736958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737059 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.737999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738187 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738493 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.738888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739430 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.739846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740046 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740137 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740348 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740441 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.740959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.741057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.741264 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.741364 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.741573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.741699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.743053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.744204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.744871 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.745923 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746184 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746840 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.746965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747156 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747277 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.747871 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748147 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748405 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.748934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749449 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749817 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.749942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.750975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751268 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.751904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752541 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752669 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.752939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.753958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754091 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754612 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754736 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.754994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755275 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755275 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.755920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756043 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756570 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756831 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.756956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757349 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757474 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757606 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.757959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.758978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.759918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760074 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760342 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.760735 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.761483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.761633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.761771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.761899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762175 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.762920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763333 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.763998 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764268 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.764904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.765966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766496 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766629 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766757 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.766883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767194 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767448 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767713 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.767952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768269 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.768922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769197 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.769992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.770868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771094 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771643 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.771990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.772193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.772297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.772528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.772726 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.772879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773164 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773361 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.773893 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.774077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.774233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.774423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.774620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.774911 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.775216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.775447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.775705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.775972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.776185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.776416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.776587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777778 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.777869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778409 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778409 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778816 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778947 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.778947 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.779221 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.779347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.779500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.779612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.779834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.780882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.781048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.781283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.781502 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.781664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.781835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782860 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.782943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783314 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783423 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.783749 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784848 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.784948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.785217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.785426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.785526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.785826 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.786013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.786135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.786444 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.786601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.786737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787066 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787378 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787539 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.787859 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788015 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788504 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788656 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.788987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789452 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789591 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.789902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.790044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.790215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.790593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.790737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.790885 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.791873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792176 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792779 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.792922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793071 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793399 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.793989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794288 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794570 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.794868 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795186 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795635 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.795933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796230 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796832 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.796981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797267 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.797948 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798877 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.798988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.799928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800736 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.800884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801022 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801244 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801893 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.801997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.802218 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.802419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.802538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.802767 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.802861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803200 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.803884 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804361 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.804970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805268 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.805976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.806176 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.806277 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.806476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.806574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.806783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807103 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807449 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807756 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.807855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808147 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808472 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808680 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808778 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.808980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809074 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809282 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809590 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.809996 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810790 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.810894 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811422 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.811863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812328 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.812923 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813322 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813629 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813838 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.813940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814251 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814449 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814749 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.814840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815067 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815373 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815467 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.815983 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.816082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.816288 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.816381 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.816943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.817934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818255 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.818891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819115 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819521 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.819817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820037 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820128 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820346 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.820960 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.821914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822244 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.822914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823429 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.823851 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824767 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.824972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825072 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825277 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825383 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825890 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.825990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.826193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.826291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.826500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.826669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.826811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827479 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827759 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.827991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828521 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.828932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829252 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.829873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830497 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830713 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.830818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831043 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.831982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.832901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833227 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833420 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833736 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.833959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834059 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.834949 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835071 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835678 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835887 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.835986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.836881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837087 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837492 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837682 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.837981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838125 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838734 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.838943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839271 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.839874 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840016 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.840891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841030 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.841927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.842941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.843945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.844933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845145 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845243 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845560 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845758 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.845874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846067 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846161 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.846993 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847116 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.847960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848052 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848268 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848570 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.848914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.849900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850111 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.850821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851778 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.851983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852807 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.852939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.853203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.853379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.853484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.853744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.853851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.854057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.854236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.854372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.854525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.854710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855031 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.855837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 08:06:02.855977 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.856298 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.856604 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.856925 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.857247 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.857590 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.857900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.858239 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.858562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.858871 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.859202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.859504 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 08:06:02.859742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 08:06:02.920840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Registered counter for database nova_api Jun 18 08:06:02.923795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Registered counter for database nova_api Jun 18 08:06:02.942198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:02.944565 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:02.949437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:02.951703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.004571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.context [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45c5db4e-158a-4a75-9b44-9638d16c22a0(cell1) {{(pid=117615) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 08:06:03.007473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.context [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45c5db4e-158a-4a75-9b44-9638d16c22a0(cell1) {{(pid=117616) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 08:06:03.008658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:06:03.010265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:06:03.011059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:06:03.011593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:06:03.013015 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:06:03.013159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:06:03.013957 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:06:03.014997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Registered counter for database nova_cell0 Jun 18 08:06:03.015965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:06:03.017979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Registered counter for database nova_cell0 Jun 18 08:06:03.019056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Registered counter for database nova_cell1 Jun 18 08:06:03.022130 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Registered counter for database nova_cell1 Jun 18 08:06:03.027895 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.028688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.030797 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.033388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.035951 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.037243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.038354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.179433 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.190630 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Registered counter for database nova_cell0 Jun 18 08:06:03.194582 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Registered counter for database nova_cell0 Jun 18 08:06:03.199954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.201602 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 08:06:03.204585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.206224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 08:06:03.518254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 08:06:03.518630 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 08:06:03.525559 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 08:06:03.525953 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 08:06:03.868450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 08:06:03.874759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-c78b73ed-e31b-4709-a5dd-6a85f0bcff99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 08:06:03.880913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55990ffbf9c0 pid: 117615 (default app) Jun 18 08:06:03.885707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 08:06:03.891795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-b1e9f827-a2de-420b-b0ce-d226ed070fc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 08:06:03.897168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55990ffbf9c0 pid: 117616 (default app) Jun 18 08:06:57.232037 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:06:57.233528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:06:57.234220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:06:57.235081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:06:58.429232 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-83728693", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "networks": [{"uuid": "57b43818-8a20-411e-9055-1296d302b73e"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:06:59.532260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] validate_networks() for [('57b43818-8a20-411e-9055-1296d302b73e', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:01.575515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:01.576092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:01.576585 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:01.577089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:01.577650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:01.615999 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:01.617360 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:01.619748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:01.621559 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:01.736444 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Getting quotas for project 2c80bfefeba54986bdbbf7339617e26f. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:01.762369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Getting quotas for user 5c5275d428074c238c0030231e8700cd and project 2c80bfefeba54986bdbbf7339617e26f. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:01.807925 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:01.811099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:01.994123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-af72cb86-4636-4060-8441-115cb4d0fc94 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.783855 Jun 18 08:07:01.994812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:07:02.383170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ee663b75-a4ca-4024-bc7a-89f5503eabe7 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:02.384799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ee663b75-a4ca-4024-bc7a-89f5503eabe7 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:02.387315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:02.388842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:02.390402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:02.391424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:03.072345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3497eaf3-94f3-4fa2-975d-00351dcf071f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: .version_select at 0x7f3be4847550>, body: {"keypair": {"name": "tempest-keypair-1931370856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvtX2n3B6DmCr0VOePCojO2Vk4Mva7chzB61K0ZPOn2rwOjRNFGGWwUGTuLs4dnPWjw/06j4nogL4RattQqR0aMtATUK65o42DU9ETkjYRxqoz4IJmfyfp8Fn2idTn50A=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:03.153390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3497eaf3-94f3-4fa2-975d-00351dcf071f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:03.169441 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3497eaf3-94f3-4fa2-975d-00351dcf071f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for user 4580375d8069479ab2f18025be4d2128 and project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:03.296089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3497eaf3-94f3-4fa2-975d-00351dcf071f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.462809 Jun 18 08:07:03.303267 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:07:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:03.887919 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ee663b75-a4ca-4024-bc7a-89f5503eabe7 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:03.923787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ee663b75-a4ca-4024-bc7a-89f5503eabe7 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1213 microversion: 2.1 time: 1.920361 Jun 18 08:07:03.927330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:02 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1213 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:04.389859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e04e1198-92c2-40cc-98a6-d9bb9813b8c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: .version_select at 0x7f3be48551f0>, body: {"keypair": {"name": "tempest-keypair-422127038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6iIAbOUDaXJ/Xaq4iohtBuTxpWUZArjo7t4l/7DLXbIBMIOsCZe6faqh4n77J+v8AZPH//LY+uC1taJbskX5ZQNx2DN6iOEmhAwZUkeyc8zFVr5klCjJ9QlaszzsEtAg=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:04.411890 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-e04e1198-92c2-40cc-98a6-d9bb9813b8c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for project fc9abdfe8063473abfa91f578081eb0d. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:04.417188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-e04e1198-92c2-40cc-98a6-d9bb9813b8c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for user 39cd1520458f49df9ff4edb63c09f746 and project fc9abdfe8063473abfa91f578081eb0d. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:04.464096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e04e1198-92c2-40cc-98a6-d9bb9813b8c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.434548 Jun 18 08:07:04.465506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 3/4] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Jun 18 08:07:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 436 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 08:07:04.478185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-281223102", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:04.701260 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] validate_networks() for [('da69f43b-cedd-4ee1-8ba8-69d4e8c9ce3f', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:04.941677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:04.942528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:04.974171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:04.979973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:04.980939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:04.981481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:05.471080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:05.486957 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5358a66f-9a18-4ec6-a730-85492e790068 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1209 microversion: 2.1 time: 0.549977 Jun 18 08:07:05.505891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 4/5] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:04 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1209 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:06.521310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:06.522097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:06.542320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:06.545976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:06.546849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:06.556897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:06.751059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:06.760645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4f9f1905-f4aa-465f-a7d2-4c36ad2af960 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1271 microversion: 2.1 time: 0.243566 Jun 18 08:07:06.764586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 5/6] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:06 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:07.599052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:07.599824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:07.600460 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:07.601072 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:07.601954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:07.637727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:07.638180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:07.658360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:07.661127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:07.774656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:07.779473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:07.779828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:07.790596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:07.791968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:07.792777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:07.793209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:07.803068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for user 62c79651096b4ac3a7414e70c8bdcd7e and project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:07.911526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:07.927962 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:08.168124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0a46fcf-1bce-4ac1-b6cf-b61cd83f82e9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.998636 Jun 18 08:07:08.174823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 2/7] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:07:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 4007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:07:08.181105 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-93e33d5a-8f1c-496e-856d-0aaa3874dbf4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:08.181719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-93e33d5a-8f1c-496e-856d-0aaa3874dbf4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:08.617216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:08.636481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-308e8a0f-07d7-47fc-9560-27cea5e36090 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1271 microversion: 2.1 time: 0.861279 Jun 18 08:07:08.652202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:07 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1271 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:08.797117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-93e33d5a-8f1c-496e-856d-0aaa3874dbf4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:08.814210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-93e33d5a-8f1c-496e-856d-0aaa3874dbf4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1221 microversion: 2.1 time: 0.634761 Jun 18 08:07:08.839061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 3/9] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:08 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1221 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:09.658829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-216670868", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:09.676939 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:09.679742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:09.702579 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:09.707631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:09.709245 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:09.715468 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:09.861912 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] validate_networks() for [('da69f43b-cedd-4ee1-8ba8-69d4e8c9ce3f', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:10.504635 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:10.564257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-89462dcf-263b-46ef-aa62-e785e72a877c tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1271 microversion: 2.1 time: 0.900023 Jun 18 08:07:10.570049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 4/10] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:09 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1271 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:11.582393 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:11.584769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:11.601887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:11.606514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:11.609612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:11.610332 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:11.675316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:12.202541 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:12.202959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:12.203451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:12.203854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:12.204276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:12.247747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:12.254472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:12.264593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:12.266653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:12.343488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:12.370926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for user 62c79651096b4ac3a7414e70c8bdcd7e and project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:12.392795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:12.405798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35a7649f-3543-44cb-a156-35f443ded49d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1271 microversion: 2.1 time: 0.827322 Jun 18 08:07:12.406494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:11 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1271 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:12.486073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:12.495212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:12.756573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1216b1cb-9641-46f8-911f-48faa39d44e5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.101667 Jun 18 08:07:12.759694 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 7/12] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:07:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:07:12.769884 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b48a9793-65c2-4591-b3e0-fcecaf3a2383 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:12.771579 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b48a9793-65c2-4591-b3e0-fcecaf3a2383 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:13.132870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1822348532", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "838e60ac-16d8-4c86-8375-153c589f9f8c"}], "security_groups": [{"name": "tempest-securitygroup--701503889"}], "key_name": "tempest-keypair-1931370856", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:13.215979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b48a9793-65c2-4591-b3e0-fcecaf3a2383 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:13.230479 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b48a9793-65c2-4591-b3e0-fcecaf3a2383 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1221 microversion: 2.1 time: 0.464587 Jun 18 08:07:13.232116 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:12 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1221 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:13.426177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:13.439741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:13.457822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:13.467710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:13.472230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:13.476590 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:13.749460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] validate_networks() for [('838e60ac-16d8-4c86-8375-153c589f9f8c', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:14.166728 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:14.178347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94b86269-a221-481b-93af-f04812bfbc7e tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.756830 Jun 18 08:07:14.183328 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:13 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:14.193833 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-786800171", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7f79979-914c-42cc-bb29-5a94ac49a40c"}], "security_groups": [{"name": "tempest-securitygroup--557063945"}], "key_name": "tempest-keypair-422127038", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:14.488994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] validate_networks() for [('c7f79979-914c-42cc-bb29-5a94ac49a40c', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:16.409004 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:16.409599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:16.410202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:16.410803 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:16.411492 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:16.443267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:16.449841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:16.450849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:16.455682 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:16.522187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for project fc9abdfe8063473abfa91f578081eb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:16.529933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for user 39cd1520458f49df9ff4edb63c09f746 and project fc9abdfe8063473abfa91f578081eb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:16.566329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:16.585966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:16.721729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6953ae7a-e97a-415f-a84f-5224c0176834 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.536881 Jun 18 08:07:16.731525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 8/15] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Jun 18 08:07:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 08:07:16.737913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:16.738666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:16.758044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:16.758503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:16.766811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:16.767911 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:17.133599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:17.134866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:17.135571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:17.136190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:17.136921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:17.153522 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:17.154348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:17.155560 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:17.159614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:17.205283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:17.214295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for user 4580375d8069479ab2f18025be4d2128 and project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:17.245188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:17.250470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:17.373958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0c1fe47d-3cd1-4918-b8bb-064dd1cc2625 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.246799 Jun 18 08:07:17.374620 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:07:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 4249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 08:07:17.386638 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:17.387518 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:17.397435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:17.399397 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:17.400345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:17.400962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:17.486364 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:17.518294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fd626902-7cad-4fe1-bc57-15b3283c0e02 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1279 microversion: 2.1 time: 0.788804 Jun 18 08:07:17.525014 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:16 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1279 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:17.549580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:17.554358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:18.052738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.066688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.068930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.070840 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-71768437-1bf6-4048-909e-f581969da314 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1280 microversion: 2.20 time: 0.544334 Jun 18 08:07:18.076803 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 10/18] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:17 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1280 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:18.088342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-01e8eb17-0c45-4c92-8cd4-f5ca80019cc4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:18.090628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-01e8eb17-0c45-4c92-8cd4-f5ca80019cc4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:18.418157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01e8eb17-0c45-4c92-8cd4-f5ca80019cc4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.438612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-01e8eb17-0c45-4c92-8cd4-f5ca80019cc4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1238 microversion: 2.1 time: 0.356914 Jun 18 08:07:18.446379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 11/19] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:18 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1238 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:18.551606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:18.553193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:18.569596 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:18.573389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:18.576382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:18.576976 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:18.633963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.655132 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1f196db1-d6c4-41f5-a9cd-96f40b25202a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 1.273864 Jun 18 08:07:18.656129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 9/20] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:17 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:18.913984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:18.946526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bf2c1696-ac72-46d4-b3c2-0edbc251421b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1279 microversion: 2.1 time: 0.402702 Jun 18 08:07:18.952961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 12/21] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:18 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1279 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:19.102378 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:19.103433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:19.116047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.116505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:19.117320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.123351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:19.458955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:19.459709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:19.483507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.484172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:19.487193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.496536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:19.499686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:19.524854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:19.530433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:19.533892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-00fa785d-cac7-4cab-b59f-124a7b17e10c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1340 microversion: 2.20 time: 0.435556 Jun 18 08:07:19.559738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 10/22] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:19 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1340 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:19.673576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:19.674225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:19.697184 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.700926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:19.701840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:19.702294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:20.085026 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:20.093373 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c4a83375-28ae-49c6-b135-51c875db96dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1234 microversion: 2.1 time: 0.639156 Jun 18 08:07:20.096015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 13/23] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:19 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1234 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:20.116750 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:20.117952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:20.129223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:20.129915 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:20.130941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:20.133007 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:20.275107 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:20.284694 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4418dc81-5c4f-462d-904d-4412907aeeb3 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.615957 Jun 18 08:07:20.296884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:19 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:20.345284 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:20.369633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5c362d66-7130-4851-8eca-7a92c6756e7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1279 microversion: 2.1 time: 0.270172 Jun 18 08:07:20.385534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 14/25] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:20 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1279 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:20.562369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:20.563211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:20.570968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:20.577288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:20.578140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:20.578579 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.018294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:21.041505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:21.048046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:21.059396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b5dd1056-4000-4c59-ad81-2a2897b5e0f5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1338 microversion: 2.20 time: 0.501123 Jun 18 08:07:21.070073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 12/26] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:20 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1338 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:21.115879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:21.117363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:21.130018 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.131469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.134989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.137814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.304416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:21.305041 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:21.330414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.331239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.334294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.334710 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.659904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:21.671198 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-908a0f12-0618-40c6-a615-2fc322e39b2e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1308 microversion: 2.1 time: 0.560664 Jun 18 08:07:21.679511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:21 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:21.684483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:21.695967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:21.711464 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.711916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:21.712703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:21.713132 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.075261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:22.101797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5d804e7-9a02-44ca-9ab6-8a53407c169a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.787629 Jun 18 08:07:22.102956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 13/28] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:21 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:22.372139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3723605b-b750-4dd3-91af-8050cfc8482f req-91f6e82a-ecaa-4f78-8eee-ed92ba4b1c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6dff9b-5738-4371-9eca-ffe2ffebdc8b", "tag": "ac024896-ecc5-41cf-951e-462d3c0bb004"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:22.408345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3723605b-b750-4dd3-91af-8050cfc8482f req-91f6e82a-ecaa-4f78-8eee-ed92ba4b1c7d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.408880 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3723605b-b750-4dd3-91af-8050cfc8482f req-91f6e82a-ecaa-4f78-8eee-ed92ba4b1c7d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.476993 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3723605b-b750-4dd3-91af-8050cfc8482f req-91f6e82a-ecaa-4f78-8eee-ed92ba4b1c7d service nova] Creating event network-changed:ac024896-ecc5-41cf-951e-462d3c0bb004 for instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b on hv-cinder-82634 Jun 18 08:07:22.480775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3723605b-b750-4dd3-91af-8050cfc8482f req-91f6e82a-ecaa-4f78-8eee-ed92ba4b1c7d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 08:07:22.486521 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.487254 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.491531 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.492307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.537655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.compute.rpcapi [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 08:07:22.540623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] Releasing lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 08:07:22.582705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5b6f35df-f36c-4eca-a102-3352567c0a37 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478358 Jun 18 08:07:22.584001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:22.745903 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-8bdda754-7584-43a1-a0a8-5884354958ab req-972a1e2f-3bb6-43b0-b80f-97efef4b9122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f43c1dc-385b-4a5e-8e43-7f7a359df2fb", "tag": "93d9df61-4cf9-4600-9e37-ac0d1bc0e72e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:22.757047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8bdda754-7584-43a1-a0a8-5884354958ab req-972a1e2f-3bb6-43b0-b80f-97efef4b9122 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.757798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8bdda754-7584-43a1-a0a8-5884354958ab req-972a1e2f-3bb6-43b0-b80f-97efef4b9122 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.773166 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-8bdda754-7584-43a1-a0a8-5884354958ab req-972a1e2f-3bb6-43b0-b80f-97efef4b9122 service nova] Creating event network-changed:93d9df61-4cf9-4600-9e37-ac0d1bc0e72e for instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb on hv-cinder-82634 Jun 18 08:07:22.780969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-8bdda754-7584-43a1-a0a8-5884354958ab req-972a1e2f-3bb6-43b0-b80f-97efef4b9122 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194686 Jun 18 08:07:22.781912 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 15/30] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:22.788547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:22.789509 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:22.796489 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.797017 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.797847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.798465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.912177 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:22.921247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:22.923867 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:22.925014 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c007e48-4322-4e19-9657-531538ad89d7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1338 microversion: 2.20 time: 0.141893 Jun 18 08:07:22.925659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:22 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:22.938594 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:22.942608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:22.952526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.952975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.955631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:22.956737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:22.982624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:22.996134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e3334167-ac3c-48a9-a475-32a3a6d83aa9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 1.314231 Jun 18 08:07:23.006371 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:21 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:23.070900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:23.083297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-969771a6-1d21-4484-9e07-b0c2575af91c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1296 microversion: 2.1 time: 0.155786 Jun 18 08:07:23.095917 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 17/33] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:22 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:23.123505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:23.124165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:23.134226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:23.135628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:23.136441 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:23.139098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:23.640450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:23.650359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-65424d22-7676-41c8-a411-a224699e56d6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.532393 Jun 18 08:07:23.651463 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:23 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:23.947118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:23.947118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:23.956186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:23.960739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:23.961470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:23.962481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:23.963154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.015159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:24.016567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:24.023903 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.024689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.026384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.027085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.049972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:24.061225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:24.067267 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:24.071074 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1d025bb4-9c1e-4b33-886d-42fc80728ec1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1338 microversion: 2.20 time: 0.128824 Jun 18 08:07:24.081944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:23 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1338 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:24.120204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:24.121843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:24.139340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.145981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.147396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.148095 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.245016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:24.253590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c20a29c7-d8ca-49fb-8e83-df08e5c9c388 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1296 microversion: 2.1 time: 0.155594 Jun 18 08:07:24.255863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 19/36] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:24 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:24.668159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:24.669076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:24.680807 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.684090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.685096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:24.685687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:24.900993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:24.910900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c65cfbd4-6948-404e-b0ee-dd7e2bea952b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.900789 Jun 18 08:07:24.912448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 18/37] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:24 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:25.004514 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:25.015048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ff540f95-9638-404c-87a1-8837c1c8d5a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.351233 Jun 18 08:07:25.019714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:24 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:25.091167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:25.092213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:25.098733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.099990 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.101506 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.102402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.271987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:25.272654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:25.288552 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.289001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.290320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.290754 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.596750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:25.607196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-292a7fc0-41c0-4001-85cb-b036103e637c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.339216 Jun 18 08:07:25.608642 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:25 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:25.928105 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:25.928404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:25.929901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:25.939859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.946754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:25.947583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.950889 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:25.951499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:25.953875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:25.958647 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-455f7759-39a2-4339-b4b6-f2bdd8bb6974 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.868916 Jun 18 08:07:25.959870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:25 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:26.026795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:26.073705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:26.075306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:26.087322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.088005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.089723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.091041 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.254265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:26.269386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d62c430c-a9cc-407e-891c-b899eb9f02ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.345264 Jun 18 08:07:26.281295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:25 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:26.465305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:26.487124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b6e1273e-296a-4d56-856b-31aa70e26109 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.452189 Jun 18 08:07:26.489521 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 20/42] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:26 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:26.626200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:26.626897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:26.636114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.636537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.639585 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.640026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.665895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-82a453be-b95d-4f82-bf1b-46e6374cc886 req-fb734c77-e395-46a7-b07a-254fa0241046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b", "tag": "46fd2c16-c347-4bbd-87a9-0228ef945bff"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:26.669761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:26.687928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-82a453be-b95d-4f82-bf1b-46e6374cc886 req-fb734c77-e395-46a7-b07a-254fa0241046 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.694436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-82a453be-b95d-4f82-bf1b-46e6374cc886 req-fb734c77-e395-46a7-b07a-254fa0241046 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.763487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-82a453be-b95d-4f82-bf1b-46e6374cc886 req-fb734c77-e395-46a7-b07a-254fa0241046 service nova] Creating event network-changed:46fd2c16-c347-4bbd-87a9-0228ef945bff for instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b on hv-cinder-82634 Jun 18 08:07:26.764310 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-82a453be-b95d-4f82-bf1b-46e6374cc886 req-fb734c77-e395-46a7-b07a-254fa0241046 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 08:07:26.778039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.778039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.778039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.778039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.793109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.compute.rpcapi [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 08:07:26.796473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] Releasing lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 08:07:26.837102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d9f78051-2a15-4bc8-9f6d-80a1c3bca24b None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176156 Jun 18 08:07:26.838080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 21/43] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:07:26.977548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:26.978691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:26.990854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.991696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:26.992718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:26.993380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:27.120817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:27.133649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e42468c-66d2-492b-bd02-92db4445047b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.512422 Jun 18 08:07:27.134615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:26 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:27.288651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:27.290216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:27.293325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=26 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:27.300354 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:27.301010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:27.302162 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:27.302833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:27.956135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:27.969999 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82df8bb1-3e31-47f4-b6f6-30138d7e46d3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.685459 Jun 18 08:07:27.974319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 24/45] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:27 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:28.006195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:28.008748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:28.031110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:28.031988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:28.033127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:28.034870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:28.136456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:28.146442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:28.147959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:28.149108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9ad6a1a9-d99f-480b-a529-1e87f1ff7bce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 1.175989 Jun 18 08:07:28.158828 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:26 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:07:28.175697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:28.176542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:28.188743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:28.189469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:28.190377 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:28.191362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:28.423374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=22 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:28.769155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:28.780478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d152eed6-767c-4341-898f-3c923ad50a9a tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.804037 Jun 18 08:07:28.792058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 25/47] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:27 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:28.821581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:28.840676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6faebc65-4b60-4634-bb64-21190fddf390 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.673814 Jun 18 08:07:28.856109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:28 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:28.989608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:28.990488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:29.002691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.003430 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.004562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.005171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.176051 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:29.177926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:29.206187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.207283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.208693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.209343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.214971 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:29.320922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:29.328769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-510d1b83-c0ef-4024-bc2f-31089d988ba3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.342967 Jun 18 08:07:29.333545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 26/49] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:28 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:29.584600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-49191b61-9d72-476b-afde-4d49ae9a3595 req-eb325075-cb36-4c22-b75a-bc11382b7549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:29.607977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-49191b61-9d72-476b-afde-4d49ae9a3595 req-eb325075-cb36-4c22-b75a-bc11382b7549 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.623185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-49191b61-9d72-476b-afde-4d49ae9a3595 req-eb325075-cb36-4c22-b75a-bc11382b7549 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.656003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-49191b61-9d72-476b-afde-4d49ae9a3595 req-eb325075-cb36-4c22-b75a-bc11382b7549 service nova] Creating event network-changed:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:07:29.678842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-49191b61-9d72-476b-afde-4d49ae9a3595 req-eb325075-cb36-4c22-b75a-bc11382b7549 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098055 Jun 18 08:07:29.681989 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 27/50] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:07:29.798430 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:29.799401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:29.811573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.812406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:29.814482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:29.820843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.245034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:30.255215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b2334813-2600-47ab-a657-65365b26a122 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.461114 Jun 18 08:07:30.258646 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 28/51] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:29 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:30.264456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:30.270084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:30.284865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:30.285665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.290947 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:30.291727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.538337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:30.546516 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-827b1e8b-17e9-462e-9aca-38b06f4fe367 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.285761 Jun 18 08:07:30.549014 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 29/52] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:30 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:30.720931 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-224d5450-87ca-4b22-a40a-1fd733423d8d req-b98b56c3-61e5-4dcd-bfd2-e4d75aaa8b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f43c1dc-385b-4a5e-8e43-7f7a359df2fb", "name": "network-vif-plugged", "status": "completed", "tag": "93d9df61-4cf9-4600-9e37-ac0d1bc0e72e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:30.731321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-224d5450-87ca-4b22-a40a-1fd733423d8d req-b98b56c3-61e5-4dcd-bfd2-e4d75aaa8b85 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:30.732092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-224d5450-87ca-4b22-a40a-1fd733423d8d req-b98b56c3-61e5-4dcd-bfd2-e4d75aaa8b85 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.745427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-224d5450-87ca-4b22-a40a-1fd733423d8d req-b98b56c3-61e5-4dcd-bfd2-e4d75aaa8b85 service nova] Creating event network-vif-plugged:93d9df61-4cf9-4600-9e37-ac0d1bc0e72e for instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb on hv-cinder-82634 Jun 18 08:07:30.751366 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-224d5450-87ca-4b22-a40a-1fd733423d8d req-b98b56c3-61e5-4dcd-bfd2-e4d75aaa8b85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199944 Jun 18 08:07:30.756511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 30/53] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:30.762248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:30.763307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:30.769961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:30.770636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.771660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:30.772050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:30.808040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:30.834454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:30.842804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:30.848170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-572f7e57-0277-40da-a682-b5184a0bc025 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 1.676019 Jun 18 08:07:30.869682 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 24/54] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:29 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:07:31.010555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:31.040813 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d780c3b-64b9-4b7e-82ee-579f2630430e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.282627 Jun 18 08:07:31.042208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 31/55] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:30 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:31.276538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:31.278139 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:31.286489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.287234 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.288361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.289113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.501985 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:31.519034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-19e1d13b-bf12-4e13-bbf3-989c59345212 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.239439 Jun 18 08:07:31.519034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 25/56] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:31 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:31.565180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:31.566172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:31.572951 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.574011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.575224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.575870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.753526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:31.762654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e2747064-09f6-4b0c-8bdd-b1d1e1c6b2ee tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.201690 Jun 18 08:07:31.763269 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 32/57] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:31 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:31.815112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2ae836b9-f280-4404-b692-ec0c6abc29c2 req-4acde1b3-d026-4dd2-8aea-a9eadb3eb840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15e626c-3e18-47cb-857d-b92aafddfbb4", "tag": "6775f598-dc03-4fff-a272-ad6c75956058"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:31.828028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2ae836b9-f280-4404-b692-ec0c6abc29c2 req-4acde1b3-d026-4dd2-8aea-a9eadb3eb840 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.828465 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2ae836b9-f280-4404-b692-ec0c6abc29c2 req-4acde1b3-d026-4dd2-8aea-a9eadb3eb840 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.846515 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2ae836b9-f280-4404-b692-ec0c6abc29c2 req-4acde1b3-d026-4dd2-8aea-a9eadb3eb840 service nova] Creating event network-changed:6775f598-dc03-4fff-a272-ad6c75956058 for instance e15e626c-3e18-47cb-857d-b92aafddfbb4 on hv-cinder-82634 Jun 18 08:07:31.856361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2ae836b9-f280-4404-b692-ec0c6abc29c2 req-4acde1b3-d026-4dd2-8aea-a9eadb3eb840 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044596 Jun 18 08:07:31.857228 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 26/58] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:31.872504 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:31.873192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:31.879434 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.880120 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:31.880877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:31.881455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.035375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:32.045833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:32.048681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:32.050238 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b394b015-39ce-46c2-bfaf-9c4b8116b27b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.181485 Jun 18 08:07:32.051358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 33/59] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:31 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:32.059326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:32.060184 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:32.072760 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.073351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.073995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.074431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.484301 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:32.496899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-168d5402-cc80-408e-9894-30300289fa24 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.441387 Jun 18 08:07:32.498092 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 27/60] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:32 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:32.532010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:32.534593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:32.541987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:32.559834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.561000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.562601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.563085 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.779906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:32.780643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:32.782663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:32.785291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:32.794740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.797350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.799563 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e8d4d0f-8629-481e-bb48-f326fbd6b0df tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.273672 Jun 18 08:07:32.800123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.800739 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.802906 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 34/61] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:32 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:32.834985 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-97cc964d-c147-4400-b898-c1b6c3583d88 req-35e6c0d2-fffc-449d-a2f6-b302e6d99a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6dff9b-5738-4371-9eca-ffe2ffebdc8b", "name": "network-vif-plugged", "status": "completed", "tag": "ac024896-ecc5-41cf-951e-462d3c0bb004"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:32.853068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-97cc964d-c147-4400-b898-c1b6c3583d88 req-35e6c0d2-fffc-449d-a2f6-b302e6d99a91 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:32.856467 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-97cc964d-c147-4400-b898-c1b6c3583d88 req-35e6c0d2-fffc-449d-a2f6-b302e6d99a91 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:32.891959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-97cc964d-c147-4400-b898-c1b6c3583d88 req-35e6c0d2-fffc-449d-a2f6-b302e6d99a91 service nova] Creating event network-vif-plugged:ac024896-ecc5-41cf-951e-462d3c0bb004 for instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b on hv-cinder-82634 Jun 18 08:07:32.904415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-97cc964d-c147-4400-b898-c1b6c3583d88 req-35e6c0d2-fffc-449d-a2f6-b302e6d99a91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071699 Jun 18 08:07:32.905066 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 35/62] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:33.069084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:33.069884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:33.076741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.077365 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.078621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.079318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.079520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.087592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-99b5d91a-a9d8-422c-8117-fe5e3eb7d27c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.311377 Jun 18 08:07:33.088701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 28/63] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:32 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:33.261327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.277723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.277723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.277723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-232593fa-9444-4419-bddb-030912aa0046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.211092 Jun 18 08:07:33.278170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 36/64] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:33 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:33.517959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:33.518571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:33.532191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.532637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.533421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.533834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.754032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.763775 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4b0341d8-886f-424a-b3f8-f7d2caee0546 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.253119 Jun 18 08:07:33.764432 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 29/65] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:33 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:33.820786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:33.821496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:33.829472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.830272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.831173 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:33.831948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:33.976939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:33.986051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bdaf1629-3b18-431c-8353-d7b864d83ff1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.169600 Jun 18 08:07:33.986636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 37/66] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:33 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:34.107256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:34.107870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:34.115837 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.117584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.118368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.118802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.295809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:34.297099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:34.307733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.309764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.310766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.311231 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.477742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:34.482437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b6f37554-f744-43ee-b84f-570b839185ce tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.379745 Jun 18 08:07:34.483049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 30/67] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:34 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:34.602104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:34.612360 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:34.615558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:34.616848 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09e08885-74b4-4cba-bc44-5eb2bd8ff64c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.325231 Jun 18 08:07:34.623122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 38/68] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:34 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:07:34.790685 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:34.791417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:34.798181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.798889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.799966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.800545 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.957476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-c275f254-c3e2-438d-bb6e-bfb472c0ef28 req-b69852bf-525d-45e3-af78-cd2a2c3b945c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b", "name": "network-vif-plugged", "status": "completed", "tag": "46fd2c16-c347-4bbd-87a9-0228ef945bff"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:34.967804 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c275f254-c3e2-438d-bb6e-bfb472c0ef28 req-b69852bf-525d-45e3-af78-cd2a2c3b945c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:34.968703 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c275f254-c3e2-438d-bb6e-bfb472c0ef28 req-b69852bf-525d-45e3-af78-cd2a2c3b945c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:34.982968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-c275f254-c3e2-438d-bb6e-bfb472c0ef28 req-b69852bf-525d-45e3-af78-cd2a2c3b945c service nova] Creating event network-vif-plugged:46fd2c16-c347-4bbd-87a9-0228ef945bff for instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b on hv-cinder-82634 Jun 18 08:07:34.989030 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-c275f254-c3e2-438d-bb6e-bfb472c0ef28 req-b69852bf-525d-45e3-af78-cd2a2c3b945c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Jun 18 08:07:34.990290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 39/69] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:07:35.007196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:35.010165 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:35.023637 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.025330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.026883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.027583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.269472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.280097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d68ff9e-7d3f-4350-b043-cb0f0fac10e1 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.279333 Jun 18 08:07:35.281178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 40/70] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:34 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:35.385929 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.404232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-143b147f-3a17-42e4-bc06-9a6898b05269 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.618839 Jun 18 08:07:35.414343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 31/71] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:34 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:35.506223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:35.507956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:35.520163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.520934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.523000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.524746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.642051 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:35.643046 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:35.654942 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.655772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.657543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:35.658439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:35.759423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.763788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:35.777324 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-df26faf7-a41f-47fb-8d94-e0067b9f4997 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.281985 Jun 18 08:07:35.778964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 41/72] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:35 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:35.878432 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.890712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.893906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:35.903046 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ce953383-3974-4c55-be13-6609a0deb726 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.265312 Jun 18 08:07:35.909282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 32/73] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:35 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:36.300641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:36.301668 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:36.310442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.311208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.313723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.314328 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.426257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:36.427709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:36.437330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.438024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.439577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.440334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.621053 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:36.629618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8182a8e0-7632-4ced-bb08-b7a47ae68bd8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.211939 Jun 18 08:07:36.630436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 33/74] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:36 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:36.633690 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:36.641224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c59ef9ef-ecde-492c-9262-e1daa87f942b tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1313 microversion: 2.1 time: 0.347432 Jun 18 08:07:36.641788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 42/75] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:36 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:36.795374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:36.795991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:36.797934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:36.803988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.804548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.805309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.805734 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.926944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:36.927359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:36.937157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.937859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:36.938793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:36.939494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.015743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.026911 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd08f36d-7022-4501-81d9-ebeb24276f67 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.235539 Jun 18 08:07:37.028126 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 34/76] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:36 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:37.045677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-53534992-7ef5-4311-8b02-1f1f8104b400 req-4635d200-ddcd-441c-8b94-ec0860cbf7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15e626c-3e18-47cb-857d-b92aafddfbb4", "name": "network-vif-plugged", "status": "completed", "tag": "6775f598-dc03-4fff-a272-ad6c75956058"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:37.060194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-53534992-7ef5-4311-8b02-1f1f8104b400 req-4635d200-ddcd-441c-8b94-ec0860cbf7c3 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:37.060774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-53534992-7ef5-4311-8b02-1f1f8104b400 req-4635d200-ddcd-441c-8b94-ec0860cbf7c3 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.088260 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-53534992-7ef5-4311-8b02-1f1f8104b400 req-4635d200-ddcd-441c-8b94-ec0860cbf7c3 service nova] Creating event network-vif-plugged:6775f598-dc03-4fff-a272-ad6c75956058 for instance e15e626c-3e18-47cb-857d-b92aafddfbb4 on hv-cinder-82634 Jun 18 08:07:37.103038 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-53534992-7ef5-4311-8b02-1f1f8104b400 req-4635d200-ddcd-441c-8b94-ec0860cbf7c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063876 Jun 18 08:07:37.105253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 35/77] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:37.281124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.293989 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.296574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.297964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4086b142-d153-495f-8ce3-16f8ab2683f4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.375610 Jun 18 08:07:37.298744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 43/78] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:36 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:37.648705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:37.648705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:37.654216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:37.655228 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.656725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:37.657528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.660237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:37.662314 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:37.673262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:37.673864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.674645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:37.675157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:37.855668 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.867452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e83d17dd-76d3-4106-b6d2-88550b3bd3dc tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1500 microversion: 2.1 time: 0.211480 Jun 18 08:07:37.868699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 44/79] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:37 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1500 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:37.885307 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:37.892776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-05220194-5cc9-4e90-ba6e-89894aad44cd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.250927 Jun 18 08:07:37.896435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 36/80] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:37 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:38.045575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:38.046288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:38.056572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.057052 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:38.057853 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.058310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:38.320392 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:38.321105 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:38.330321 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.331024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:38.333282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.334726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:38.357805 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:38.379714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-17a49169-da77-41a0-b6c5-0122fbfc8c46 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.339220 Jun 18 08:07:38.383046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 45/81] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:38 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:38.793680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:38.805034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:38.808851 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:38.813546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f162cc8b-d95a-4b6f-af74-0947339761de tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.498866 Jun 18 08:07:38.814183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 37/82] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:38 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:38.913636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:38.914972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:38.923386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.924186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:38.925291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:38.926155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.157146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0ed6cf6f-d758-49e4-8da6-82fc09bfb7bb req-7b8d6ccd-c0c4-4af9-ad38-4b9583e5cd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "name": "network-vif-plugged", "status": "completed", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:39.170888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:39.183714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4ab88aa5-246b-4f85-9835-616eb0ae2153 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1321 microversion: 2.1 time: 0.274411 Jun 18 08:07:39.184337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 46/83] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:38 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:39.207920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0ed6cf6f-d758-49e4-8da6-82fc09bfb7bb req-7b8d6ccd-c0c4-4af9-ad38-4b9583e5cd2e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.208947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0ed6cf6f-d758-49e4-8da6-82fc09bfb7bb req-7b8d6ccd-c0c4-4af9-ad38-4b9583e5cd2e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.233776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0ed6cf6f-d758-49e4-8da6-82fc09bfb7bb req-7b8d6ccd-c0c4-4af9-ad38-4b9583e5cd2e service nova] Creating event network-vif-plugged:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:07:39.241426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0ed6cf6f-d758-49e4-8da6-82fc09bfb7bb req-7b8d6ccd-c0c4-4af9-ad38-4b9583e5cd2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105619 Jun 18 08:07:39.242446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 38/84] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:39.399623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:39.400417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:39.406856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.407623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.408505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.409124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.553411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f4e70b6-5fb7-4b6a-9a54-df40cab4d5d4"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:39.555882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:39.567458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.568193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.569450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.570030 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.575907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:39.586557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-679c4b15-8f3d-42f2-83ea-7ed823487968 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.189926 Jun 18 08:07:39.587206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 47/85] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:39 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:39.832284 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:39.833125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:39.841581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.842354 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:39.843344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:39.844415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.000572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:40.011192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:40.012985 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:40.014667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7f7d680c-a1c9-4e41-984e-1a2bf507c96e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.187109 Jun 18 08:07:40.025424 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 48/86] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:39 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:07:40.211174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:40.212992 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:40.221419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.221915 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.222838 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.223500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.466113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:40.469160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9446e3c3-2f63-42a9-8347-0d1cfcb77caa tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "POST /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920144 Jun 18 08:07:40.469754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 39/87] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:07:39 2022] POST /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:07:40.501353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b00bcc26-eedc-4e54-ae7d-371e5a90b3b9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1514 microversion: 2.1 time: 0.302444 Jun 18 08:07:40.518332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 49/88] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:40 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:40.554696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:40.556792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:40.564402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.565345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.567617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.568636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.602646 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'flavor' on Instance uuid cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:07:40.611968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:40.612578 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:40.619659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.620146 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.620924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.621354 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.701784 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:40.779069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:40.783945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f65335ff-f473-4284-b880-cccdecc88322 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b/action" status: 200 len: 32 microversion: 2.1 time: 0.265698 Jun 18 08:07:40.784562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 40/89] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:07:40 2022] POST /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 08:07:40.788562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ccfcb551-8ff5-4672-a718-8f90ba7f0237 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1363 microversion: 2.1 time: 0.181291 Jun 18 08:07:40.789392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 50/90] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:40 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:40.797683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:40.798379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:40.806123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.806665 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:40.807569 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:40.819836 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:41.007667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:41.016328 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-515a5606-7d78-489f-8797-b9db8e565f1e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.225924 Jun 18 08:07:41.017461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 41/91] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:40 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:41.035980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:41.038015 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:41.044565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:41.045280 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:41.046310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:41.047350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:41.230308 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:41.239534 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:41.241089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:41.242204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5c71bc3-6595-4d14-a390-333242ae597a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.211958 Jun 18 08:07:41.242770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 51/92] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:41 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:41.806720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:41.807417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:41.818708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:41.819490 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:41.824451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:41.825113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.034790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:42.035636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:42.047266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.047902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.048481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.051117 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.120421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:42.136309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0724d173-60b0-47bc-81cb-15794a605be8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1547 microversion: 2.1 time: 0.335204 Jun 18 08:07:42.136914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 42/93] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:41 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1547 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:42.156415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:42.156904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:42.164928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.165494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.166385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.166927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.231228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:42.239462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-84ae393d-155a-4efa-9428-f3e886fced22 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.209424 Jun 18 08:07:42.240364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 52/94] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:42 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:07:42.264505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:42.265483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:42.265620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8364201b-9a92-4575-bf42-7a8675611baf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114283 Jun 18 08:07:42.266325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 43/95] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:07:42 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:07:42.273010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.273684 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.274562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:42.275239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:42.611119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:42.621371 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:42.622850 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:42.624138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-53d7f9be-a1df-4f8c-a27d-a4eccb255d0e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1405 microversion: 2.20 time: 0.364016 Jun 18 08:07:42.624685 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 53/96] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:42 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:07:43.258750 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:43.260858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:43.268900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.269951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:43.271039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.271981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:43.489936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:43.500276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a92661c-35e6-4c73-8d8c-949458c0a2f9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.246112 Jun 18 08:07:43.503095 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 44/97] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:43 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:43.642022 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:43.642657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:43.649659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.650771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:43.651799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.652228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:43.896400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:43.905404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:43.908580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:43.910790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73e8e65a-c658-4949-a305-b16dad459f12 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1597 microversion: 2.20 time: 0.272579 Jun 18 08:07:43.911869 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 54/98] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:07:43 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1597 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:07:43.935944 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:43.936448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:43.944386 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.945081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:43.945933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:43.946576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:44.039262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33fc92c6-097f-4675-bb61-aa1afa60dd2d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108800 Jun 18 08:07:44.039861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 45/99] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Jun 18 08:07:43 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:07:44.063785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0322f49c-2db8-4e1f-933f-90beadf7dc98 req-f3a0e217-936a-496c-8332-1ab7484bf2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15e626c-3e18-47cb-857d-b92aafddfbb4", "tag": "6775f598-dc03-4fff-a272-ad6c75956058"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:44.072928 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0322f49c-2db8-4e1f-933f-90beadf7dc98 req-f3a0e217-936a-496c-8332-1ab7484bf2b1 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:44.073633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0322f49c-2db8-4e1f-933f-90beadf7dc98 req-f3a0e217-936a-496c-8332-1ab7484bf2b1 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:44.088946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0322f49c-2db8-4e1f-933f-90beadf7dc98 req-f3a0e217-936a-496c-8332-1ab7484bf2b1 service nova] Creating event network-changed:6775f598-dc03-4fff-a272-ad6c75956058 for instance e15e626c-3e18-47cb-857d-b92aafddfbb4 on hv-cinder-82634 Jun 18 08:07:44.094236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0322f49c-2db8-4e1f-933f-90beadf7dc98 req-f3a0e217-936a-496c-8332-1ab7484bf2b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034241 Jun 18 08:07:44.094858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 55/100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:44.520193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:44.521497 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:44.535600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:44.536276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:44.537227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:44.537667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:45.026926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:45.034642 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-95f9edbf-694f-42be-b8e9-26482e9d24e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.518911 Jun 18 08:07:45.035323 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 46/101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:44 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:46.055131 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:46.056788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:46.066861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:46.067390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:46.068706 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:46.069283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:46.276532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:46.285198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4547aab4-9c13-4017-94ba-45789ffdfe7b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.237122 Jun 18 08:07:46.287835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 56/102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:46 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:46.314968 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-674cd6fc-0788-4fdc-9a9e-fcbcef6d6253 req-64d16c77-76c1-4608-9c42-44a2ad842e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:46.329396 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-674cd6fc-0788-4fdc-9a9e-fcbcef6d6253 req-64d16c77-76c1-4608-9c42-44a2ad842e59 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:46.330045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-674cd6fc-0788-4fdc-9a9e-fcbcef6d6253 req-64d16c77-76c1-4608-9c42-44a2ad842e59 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:46.370910 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-674cd6fc-0788-4fdc-9a9e-fcbcef6d6253 req-64d16c77-76c1-4608-9c42-44a2ad842e59 service nova] Creating event network-changed:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:07:46.383383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-674cd6fc-0788-4fdc-9a9e-fcbcef6d6253 req-64d16c77-76c1-4608-9c42-44a2ad842e59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072527 Jun 18 08:07:46.384612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 47/103] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:47.301748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:47.302295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:47.308628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:47.309069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:47.309806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:47.310231 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:47.467471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:47.480501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0f397096-112d-41d6-a51b-e7dc02305240 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.182453 Jun 18 08:07:47.481401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 57/104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:47 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:48.501133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:48.502044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:48.510720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:48.511366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:48.512369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:48.512937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:48.655517 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:48.663087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd2de0bb-85d2-4ec8-8a7a-11c411d28725 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.168554 Jun 18 08:07:48.663659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 48/105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:48 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:49.680202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:49.680693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:49.689399 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:49.689935 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:49.691537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:49.692275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:49.848285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:49.856116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-61746780-0d1b-4ba9-bb52-01a286f9d95f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.180355 Jun 18 08:07:49.856689 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 58/106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:49 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:50.875614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:50.878902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:50.888149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:50.891250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:50.892340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:50.892767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:51.129383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:51.138258 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5579516a-b4ea-4c7c-8638-4619cab98d47 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.268840 Jun 18 08:07:51.147680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 49/107] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:50 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:51.681054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:51.681520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:51.688408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:51.688861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:51.689621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:51.690042 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:51.707514 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:51.721651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:07:51.886106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-896f6558-8f70-49ab-b2a1-11aeacff64a4 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 204 len: 0 microversion: 2.1 time: 0.210190 Jun 18 08:07:51.887070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 59/108] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:07:51 2022] DELETE /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:07:51.897206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:51.899144 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:51.911271 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:51.912598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:51.913898 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:51.914804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:52.115355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:52.124625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4086e9d-bba4-429b-93f1-616b74175be0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1552 microversion: 2.1 time: 0.232857 Jun 18 08:07:52.125457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 50/109] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:51 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:52.165793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:52.166491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:52.172503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:52.172942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:52.174154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:52.174584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:52.313368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:52.323682 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2b22322-44da-494b-832c-7cae892bb619 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.162755 Jun 18 08:07:52.324528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 60/110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:52 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:53.146292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:53.147881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:53.159607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:53.160306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:53.161688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:53.162274 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:53.337434 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:53.342636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:53.343259 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:53.347057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f4d619e0-6321-4bc9-addd-b6d4632602c2 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1552 microversion: 2.1 time: 0.208982 Jun 18 08:07:53.348076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 51/111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:53 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1552 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:53.358306 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:53.359545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:53.360618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:53.361280 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:53.585426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:53.594262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d10ce003-c291-40a3-ae03-24e782e77af6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.255907 Jun 18 08:07:53.595099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 61/112] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:53 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:54.366566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:54.368627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:54.383934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:54.384714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:54.385688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:54.386300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:54.612484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:54.613080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:54.619829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:54.621320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:54.621761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:54.622616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:54.623056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:54.631833 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:54.642658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0479ad6b-1100-433e-b063-b4be619bef95 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1552 microversion: 2.1 time: 0.282000 Jun 18 08:07:54.643913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 52/113] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:54 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1552 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:54.779217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:54.787208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73f03b40-b8e6-4684-b448-45ea7a5d9fa2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.178404 Jun 18 08:07:54.796020 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 62/114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:54 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:55.664425 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:55.667118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:55.674845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:55.675574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:55.676498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:55.677319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:55.807135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:55.807697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:55.814321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:55.814757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:55.815909 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:55.816325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:55.843879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:55.860182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5d676efb-bed8-4d63-add9-3aac59f32b06 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1510 microversion: 2.1 time: 0.203456 Jun 18 08:07:55.861185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 53/115] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:55 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:55.866267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-138468919", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "networks": [{"uuid": "fbf69721-c844-426f-8a34-466c5ae8bd57"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:55.926319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] validate_networks() for [('fbf69721-c844-426f-8a34-466c5ae8bd57', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:07:55.984048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:55.992556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1baa49f6-e5bc-435c-b6e1-77e6582bbe6e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.189434 Jun 18 08:07:55.993211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 63/116] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:55 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:55.997666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-99d0bf72-dfd1-4ec1-9f0a-527dfebdec6c req-1fc7d8b5-b8b3-4d50-a9a0-c88bb779e19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6dff9b-5738-4371-9eca-ffe2ffebdc8b", "name": "network-vif-deleted", "tag": "ac024896-ecc5-41cf-951e-462d3c0bb004"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:07:56.005323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-99d0bf72-dfd1-4ec1-9f0a-527dfebdec6c req-1fc7d8b5-b8b3-4d50-a9a0-c88bb779e19e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:56.005847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-99d0bf72-dfd1-4ec1-9f0a-527dfebdec6c req-1fc7d8b5-b8b3-4d50-a9a0-c88bb779e19e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:56.016809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-99d0bf72-dfd1-4ec1-9f0a-527dfebdec6c req-1fc7d8b5-b8b3-4d50-a9a0-c88bb779e19e service nova] Creating event network-vif-deleted:ac024896-ecc5-41cf-951e-462d3c0bb004 for instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b on hv-cinder-82634 Jun 18 08:07:56.021724 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-99d0bf72-dfd1-4ec1-9f0a-527dfebdec6c req-1fc7d8b5-b8b3-4d50-a9a0-c88bb779e19e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027362 Jun 18 08:07:56.022307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 64/117] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:07:56.276681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:07:56.277093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:07:56.277663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:07:56.278060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:07:56.278501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:07:56.288773 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:56.289211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:56.289988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:56.290441 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:56.309405 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Getting quotas for project 7fc3f6aac547489fa25a163e016f8eef. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:07:56.313415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Getting quotas for user b2e98667ae014396bd1b2e04533037be and project 7fc3f6aac547489fa25a163e016f8eef. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:07:56.325457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:07:56.328083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:07:56.379463 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5000fc92-619f-4094-89d5-ac5d8732018a tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516833 Jun 18 08:07:56.380125 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 54/118] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:07:56.390913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c29a8d1-34f4-4327-8868-d7c4d9c227c7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:56.391622 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c29a8d1-34f4-4327-8868-d7c4d9c227c7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:56.452008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c29a8d1-34f4-4327-8868-d7c4d9c227c7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:56.466261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c29a8d1-34f4-4327-8868-d7c4d9c227c7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1213 microversion: 2.1 time: 0.079542 Jun 18 08:07:56.466785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 65/119] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:56 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:56.878777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:56.879412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:56.886722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:56.887124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:56.887894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:56.888330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:56.969136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:56.979525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-031a8dc3-d194-4efb-a290-457ed8bfc89d tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1344 microversion: 2.1 time: 0.105200 Jun 18 08:07:56.990564 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 55/120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:56 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:57.009527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:57.010769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:57.017690 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:57.018195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:57.019141 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:57.019765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:57.197854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:57.205464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b2381311-ddbd-471e-82ea-72f65805ef82 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.199999 Jun 18 08:07:57.206121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 66/121] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:57 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:57.483040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:57.483660 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:57.489945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:57.490388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:57.491181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:57.491629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:57.556122 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:57.564276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-98054a2c-3be8-4505-b007-9830b91b2aa5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1265 microversion: 2.1 time: 0.085124 Jun 18 08:07:57.564841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 56/122] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:57 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:57.997370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:57.998344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:58.005335 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.006125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.007505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.008203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.053214 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.053904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.054659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lazy-loading 'fault' on Instance uuid 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:07:58.136422 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:58.149374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bf1946f7-3a65-4c3d-b9cd-76ec73c63b12 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1349 microversion: 2.1 time: 0.155586 Jun 18 08:07:58.150194 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 67/123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:57 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1349 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:58.224523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:58.225192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:58.233732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.236162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.236945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.237427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.369989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:58.378450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1156b16b-0403-46ea-9db5-804f031e70ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.159980 Jun 18 08:07:58.379195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 57/124] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:58 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:58.582543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:58.582543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:58.588656 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.589091 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.589830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:58.590233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:58.650404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:58.657906 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8ce85017-f6af-4866-83d7-b461c9364cf7 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1265 microversion: 2.1 time: 0.080016 Jun 18 08:07:58.658799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 68/125] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:58 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:59.167725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:59.168332 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:59.174829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.175294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.176253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.176676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.180812 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:07:59.210081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.210615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.211073 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lazy-loading 'fault' on Instance uuid 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:07:59.255735 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:59.265763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d4c7540f-285c-471a-948d-0ae7b533ec17 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1349 microversion: 2.1 time: 0.102071 Jun 18 08:07:59.266412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 58/126] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:59 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:59.395339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:59.395972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:59.402267 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.402709 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.403487 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.403908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.552696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:59.564242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3c26857e-01cb-46dd-bf24-6040bf15d59c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.172465 Jun 18 08:07:59.565405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 69/127] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:59 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:07:59.679605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:07:59.680241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:07:59.687403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.687864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.688651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:07:59.689095 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:07:59.756966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:07:59.767963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fbf82458-d9b0-4328-94b1-6d7d822e6593 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1265 microversion: 2.1 time: 0.095126 Jun 18 08:07:59.768728 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 59/128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:07:59 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:00.285162 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:00.285650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:00.292218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.292662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.293410 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.293853 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.324735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.325166 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.325594 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lazy-loading 'fault' on Instance uuid 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:08:00.370217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c5275d428074c238c0030231e8700cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c80bfefeba54986bdbbf7339617e26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:00.378926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b496257b-3517-4eea-85f6-bbe1bc949331 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 200 len: 1349 microversion: 2.1 time: 0.097741 Jun 18 08:08:00.379613 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 70/129] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:00 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:00.581922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:00.585146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:00.596056 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.596602 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.597776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.598403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.786353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:00.787638 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:00.794079 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.794444 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.795728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:00.795728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:00.812932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:00.828065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-168984a2-6ed7-4fa2-b680-3f363013ee66 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.247791 Jun 18 08:08:00.828718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 60/130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:00 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:00.860379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:00.867976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-57fdc150-59ce-48cd-abf2-78ddfa751b78 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1271 microversion: 2.1 time: 0.085583 Jun 18 08:08:00.868560 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 71/131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:00 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:01.396662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:01.397254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:01.404436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.406278 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.407314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.407970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.424220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] HTTP exception thrown: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Request method failure captured: Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b HTTP/1.1 Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYeg8vukUqtSxANJfChywAspPtGzH2WX7UymM2UDTIucioL2zPevH05kvXBAL1bUjxOTN9AV8kIWUbNSeyb051gWDWZlfEmH6e6sIrUJmWWr9XetjqbMq2fwyWNZGEOAGtttGSw2gDUXem4V-Nysv_2gKPOxJ5bi2sJvXq3z1HRgZfY Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:08:01.429443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c80bfefeba54986bdbbf7339617e26f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 5c5275d428074c238c0030231e8700cd Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.430895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '5c6dff9b-5738-4371-9eca-ffe2ffebdc8b'} Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:01.431684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.432813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.433825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Returning 404 to user: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:01.433825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9fa85cb3-5134-48d9-9880-034c45f780c6 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 404 len: 111 microversion: 2.1 time: 0.038683 Jun 18 08:08:01.433825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 61/132] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:01 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:08:01.564658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:01.566273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:01.576114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.576822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.577973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.578754 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.598963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] HTTP exception thrown: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Request method failure captured: Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b/os-volume_attachments HTTP/1.1 Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYeg8vukUqtSxANJfChywAspPtGzH2WX7UymM2UDTIucioL2zPevH05kvXBAL1bUjxOTN9AV8kIWUbNSeyb051gWDWZlfEmH6e6sIrUJmWWr9XetjqbMq2fwyWNZGEOAGtttGSw2gDUXem4V-Nysv_2gKPOxJ5bi2sJvXq3z1HRgZfY Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:08:01.604705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c80bfefeba54986bdbbf7339617e26f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 5c5275d428074c238c0030231e8700cd Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.606204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'server_id': '5c6dff9b-5738-4371-9eca-ffe2ffebdc8b'} Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:01.607000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:01.608501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:01.609862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Returning 404 to user: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:01.609862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8d4c79d5-da7f-4aec-a4f6-f81fbc99f58f tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046865 Jun 18 08:08:01.609862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 72/133] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:08:01 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:08:01.845305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:01.846002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:01.853818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.854354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.855157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.855593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.887890 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:01.889298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:01.897965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.898562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:01.899589 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:01.900234 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:02.000225 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:02.007988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7ed17a0-e694-48af-a00d-bad0d5cf50e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.166653 Jun 18 08:08:02.008563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 62/134] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:01 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:02.084125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:02.091968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4aeb1ab1-8361-4812-85c5-25fd575fa0a9 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.210819 Jun 18 08:08:02.092545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 73/135] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:01 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:03.025063 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:03.025663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:03.028197 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:03.034272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:03.034761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:03.035543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:03.035951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:03.113172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:03.114816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:03.122225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:03.122705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:03.123575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:03.124157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:03.179446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:03.188686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-539eb4af-59f6-4823-9b4c-dc75aade87ff tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.167095 Jun 18 08:08:03.189327 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 63/136] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:03 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:03.274413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:03.293958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-191dc95b-e404-4383-8d00-fa07bb1ea7f2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.185116 Jun 18 08:08:03.294446 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 74/137] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:03 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:04.209765 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:04.210719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:04.217586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:04.218029 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:04.218802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:04.219290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:04.309822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:04.310408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:04.317776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:04.318230 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:04.318969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:04.319445 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:04.413238 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:04.421210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1b76644e-aef2-465e-85fe-a87d086bfc51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.218071 Jun 18 08:08:04.422010 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 64/138] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:04 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:04.460567 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:04.464207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:04.469021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a28244a3-3f31-48bb-be3a-d3c820c572a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.163061 Jun 18 08:08:04.469600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:04 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:04.946149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-6735eda3-69c1-4caa-a579-a6cffd500764 req-92ebd5cb-5ed1-4422-b076-c24501081c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a182d61-1ad1-44c6-bd4d-9760d8f81f7a", "tag": "afc1115b-1416-4009-ac86-e285426039a4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:04.955607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-6735eda3-69c1-4caa-a579-a6cffd500764 req-92ebd5cb-5ed1-4422-b076-c24501081c1d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:04.956167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-6735eda3-69c1-4caa-a579-a6cffd500764 req-92ebd5cb-5ed1-4422-b076-c24501081c1d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:04.968073 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-6735eda3-69c1-4caa-a579-a6cffd500764 req-92ebd5cb-5ed1-4422-b076-c24501081c1d service nova] Creating event network-changed:afc1115b-1416-4009-ac86-e285426039a4 for instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a on hv-cinder-82634 Jun 18 08:08:04.972859 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-6735eda3-69c1-4caa-a579-a6cffd500764 req-92ebd5cb-5ed1-4422-b076-c24501081c1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Jun 18 08:08:04.973462 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 65/140] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:05.438462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:05.439400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:05.447052 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.447841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:05.448882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.449429 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:05.488424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:05.489949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:05.497311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.497753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:05.498842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.499623 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:05.612879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:05.620760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f3b74ed4-af25-4892-9601-54be031d7cc7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.186891 Jun 18 08:08:05.621450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 76/141] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:05 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:05.652705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:05.660677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-29398263-2108-4587-b283-e1cf14a68187 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.178312 Jun 18 08:08:05.661367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 66/142] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:05 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:05.976417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:05.976916 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:05.983999 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.984453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:05.985370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:05.985825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.002188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] HTTP exception thrown: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Request method failure captured: Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b HTTP/1.1 Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYeg8vukUqtSxANJfChywAspPtGzH2WX7UymM2UDTIucioL2zPevH05kvXBAL1bUjxOTN9AV8kIWUbNSeyb051gWDWZlfEmH6e6sIrUJmWWr9XetjqbMq2fwyWNZGEOAGtttGSw2gDUXem4V-Nysv_2gKPOxJ5bi2sJvXq3z1HRgZfY Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:08:06.004447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c80bfefeba54986bdbbf7339617e26f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 5c5275d428074c238c0030231e8700cd Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.005837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '5c6dff9b-5738-4371-9eca-ffe2ffebdc8b'} Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:06.006640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.007861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.009379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Returning 404 to user: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:06.009379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c50d95b-f8fd-4c0e-8054-6feec802b312 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 404 len: 111 microversion: 2.1 time: 0.033386 Jun 18 08:08:06.009379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 77/143] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:08:05 2022] DELETE /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:08:06.014769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:06.015436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] [instance: 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:06.021906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.022350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.023136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.023557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.036825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] HTTP exception thrown: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Request method failure captured: Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b HTTP/1.1 Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYeg8vukUqtSxANJfChywAspPtGzH2WX7UymM2UDTIucioL2zPevH05kvXBAL1bUjxOTN9AV8kIWUbNSeyb051gWDWZlfEmH6e6sIrUJmWWr9XetjqbMq2fwyWNZGEOAGtttGSw2gDUXem4V-Nysv_2gKPOxJ5bi2sJvXq3z1HRgZfY Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:08:06.038424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c80bfefeba54986bdbbf7339617e26f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c80bfefeba54986bdbbf7339617e26f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 2c80bfefeba54986bdbbf7339617e26f Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-DeleteServersTestJSON-1945071841 Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 5c5275d428074c238c0030231e8700cd Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-DeleteServersTestJSON-1945071841-project Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.039945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '5c6dff9b-5738-4371-9eca-ffe2ffebdc8b'} Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:06.040745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. Jun 18 08:08:06.042112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:06.043413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] Returning 404 to user: Instance 5c6dff9b-5738-4371-9eca-ffe2ffebdc8b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:06.043413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6e5a85dd-9ab6-4b3e-b317-cd0554c5a8a0 tempest-DeleteServersTestJSON-1945071841 tempest-DeleteServersTestJSON-1945071841-project] 10.222.0.23 "GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b" status: 404 len: 111 microversion: 2.1 time: 0.029061 Jun 18 08:08:06.043684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 67/144] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:06 2022] GET /compute/v2.1/servers/5c6dff9b-5738-4371-9eca-ffe2ffebdc8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:08:06.637913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:06.638537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:06.643207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:06.648743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.649183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.649943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.650368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.677797 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:06.678975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:06.681114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:06.681960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:06.689055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.689491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.690797 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:06.691266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:06.833182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:06.840870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dd2996fe-8050-463d-8426-154e76671161 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.166915 Jun 18 08:08:06.841554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 68/145] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:06 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:06.867592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:06.875117 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c646ba33-5f56-4927-a834-6c667c09b69c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.241066 Jun 18 08:08:06.875614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 78/146] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:06 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:07.857971 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:07.858591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:07.865322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:07.865729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:07.866695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:07.867215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:07.892546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:07.894107 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:07.901071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:07.901518 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:07.902293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:07.902722 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:08.026266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:08.039501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-448f379f-fa48-45f2-81e6-a47fd9ff5d2e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.185330 Jun 18 08:08:08.040176 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 69/147] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:07 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:08.125229 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:08.132850 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-01d95099-e997-40ae-98aa-f81b9fb57ee3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.244472 Jun 18 08:08:08.133437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 79/148] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:07 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:09.057042 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:09.057809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:09.064401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:09.065332 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:09.066347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:09.067120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:09.157591 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:09.159672 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:09.175233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:09.176941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:09.181466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:09.182098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:09.230753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:09.239533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c4894161-0245-4ecd-8809-c6e14756e49c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.186711 Jun 18 08:08:09.240854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 70/149] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:09 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:09.443977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:09.453095 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d3b273bc-ca87-4518-af7c-c6c3970cf990 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.307078 Jun 18 08:08:09.465063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 80/150] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:09 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:10.259359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:10.260816 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:10.269689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:10.270223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:10.271428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:10.272172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:10.472004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:10.472610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:10.479446 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:10.479991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:10.480978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:10.481472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:10.514075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:10.521708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0a96283f-1ece-4b5d-bf5a-1ea8d32c259e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.268299 Jun 18 08:08:10.523401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 71/151] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:10 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:10.630855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:10.639490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-59822b2a-8bdb-4855-875f-88d47d8516a4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.172161 Jun 18 08:08:10.640082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 81/152] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:10 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:11.539751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:11.540705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:11.549130 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:11.549808 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:11.550898 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:11.551554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:11.657262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:11.658454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:11.666641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:11.667759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:11.669207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:11.670000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:11.708380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:11.715869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-112fc819-8d8f-4b38-b682-1e8663187877 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.180956 Jun 18 08:08:11.716436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 72/153] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:11 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:11.878534 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:11.887260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-45c35fad-7f56-4b8d-b9c8-742925e2b38d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.234053 Jun 18 08:08:11.887936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 82/154] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:11 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:12.731999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:12.732854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:12.741249 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:12.743972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:12.745725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:12.746311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:12.913080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:12.916453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:12.922415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:12.929247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:12.929956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:12.930975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:12.932195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:12.942822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-87049208-98d5-4c34-bb2a-3fb1d2b9ac59 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.214594 Jun 18 08:08:12.944631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 73/155] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:12 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:13.203777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:13.212452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1bca92de-25a0-4e8d-92ff-4cacbf0d7a71 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.310402 Jun 18 08:08:13.213002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 83/156] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:12 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:13.960912 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:13.961605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:13.969994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:13.970445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:13.971253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:13.971698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:14.153365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:14.162306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b9c81897-ca33-430b-ba93-826243a76a14 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.205781 Jun 18 08:08:14.174064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 74/157] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:13 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:14.229838 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:14.231103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:14.254256 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:14.255468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:14.257863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:14.258490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:14.529082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:14.537888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-57b6e7c6-7102-4b93-8407-8232e99ee32c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.312451 Jun 18 08:08:14.538931 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 84/158] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:14 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:15.179878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:15.180484 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:15.191040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:15.195801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:15.196629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:15.197054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:15.443503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:15.466962 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2d2eed46-eb1f-4e1a-aa66-6784fc7c7de8 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.290356 Jun 18 08:08:15.480110 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 75/159] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:15 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:15.556950 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:15.558306 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:15.567403 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:15.568076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:15.568987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:15.569555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:15.820310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:15.830704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bcc08041-ea27-400f-ac19-76eac212c9f3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.279582 Jun 18 08:08:15.831735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 85/160] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:15 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:16.490471 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:16.491817 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:16.500703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:16.501716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:16.503351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:16.503969 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:16.547084 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:16.742140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:16.756448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d0881500-a029-482d-91f1-1549bb6a016c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.273938 Jun 18 08:08:16.804202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 76/161] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:16 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:16.850062 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:16.850694 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:16.859393 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:16.859849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:16.860637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:16.861080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:16.871351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4b468247-2c7f-4571-bca5-dae0bd780a03 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: .version_select at 0x7f3bdf498700>, body: {"keypair": {"name": "tempest-keypair-1531614118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCthWIjXnKB7MblxDmVzxOf0jXKiHSUoEQZtq95E0D+RvmO1y5oiWj9gJ9myPhFoZPCprUU5pefnUI8Yoc2vrsr7nrOQss/+M5TQA2wGodAtrt6R1gi/RNBbZ3gxHpK3zQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:16.905419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4b468247-2c7f-4571-bca5-dae0bd780a03 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:08:16.914745 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4b468247-2c7f-4571-bca5-dae0bd780a03 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:08:16.955538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4b468247-2c7f-4571-bca5-dae0bd780a03 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.253121 Jun 18 08:08:16.957065 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 86/162] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:08:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:08:17.140711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:17.149610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2d38a5d9-2f40-46aa-a39a-2b4975843fdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.305030 Jun 18 08:08:17.150525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 77/163] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:16 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:17.701069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-abad2476-cf35-4177-8fa6-2384c68ee51e req-0ab26008-f73b-43b0-876b-dd7cffd048f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a182d61-1ad1-44c6-bd4d-9760d8f81f7a", "name": "network-vif-plugged", "status": "completed", "tag": "afc1115b-1416-4009-ac86-e285426039a4"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:17.710810 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-abad2476-cf35-4177-8fa6-2384c68ee51e req-0ab26008-f73b-43b0-876b-dd7cffd048f8 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:17.711270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-abad2476-cf35-4177-8fa6-2384c68ee51e req-0ab26008-f73b-43b0-876b-dd7cffd048f8 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:17.725563 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-abad2476-cf35-4177-8fa6-2384c68ee51e req-0ab26008-f73b-43b0-876b-dd7cffd048f8 service nova] Creating event network-vif-plugged:afc1115b-1416-4009-ac86-e285426039a4 for instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a on hv-cinder-82634 Jun 18 08:08:17.737178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-abad2476-cf35-4177-8fa6-2384c68ee51e req-0ab26008-f73b-43b0-876b-dd7cffd048f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047646 Jun 18 08:08:17.746859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 87/164] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:17.775291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:17.776024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:17.783678 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:17.784308 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:17.785140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:17.785689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:18.167543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:18.168784 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:18.176750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:18.177394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:18.178343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:18.178963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:18.377981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:18.387183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:18.396288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bf654f10-e9b2-4854-ad60-b3abdaf5ebd5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.233010 Jun 18 08:08:18.396849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dd8b53eb-bb00-4dbc-a70a-85531edbac20 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.626578 Jun 18 08:08:18.397559 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 78/165] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:17 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:18.401496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 88/166] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:18 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:18.970711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-152054951", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626"}], "security_groups": [{"name": "tempest-securitygroup--1838756160"}], "key_name": "tempest-keypair-1531614118", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:19.139045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] validate_networks() for [('bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:08:19.416502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:19.421885 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:19.430298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.430908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.431723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.432153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.644413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:19.646115 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:08:19.646927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:08:19.647407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:08:19.647849 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:08:19.648251 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:08:19.654752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-50bc40e2-ebb6-47c0-a463-b1b8579a5e8e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1313 microversion: 2.1 time: 0.243828 Jun 18 08:08:19.655959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 89/167] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:19 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:19.662129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.662575 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.663573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.664274 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.672555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:19.673433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:19.681134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.682106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.683554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:19.684347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:19.688691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:08:19.695063 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:08:19.712927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:08:19.720669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:08:19.819075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a361bd61-5472-4e4a-b971-b0792e665e3b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858873 Jun 18 08:08:19.830762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 79/168] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:08:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:08:19.848285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e6ff9850-03f5-43a5-88f5-07f0dddc8c07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:19.849185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e6ff9850-03f5-43a5-88f5-07f0dddc8c07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:19.919428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e6ff9850-03f5-43a5-88f5-07f0dddc8c07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:19.928088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e6ff9850-03f5-43a5-88f5-07f0dddc8c07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1241 microversion: 2.1 time: 0.093095 Jun 18 08:08:19.928668 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 80/169] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:19 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:19.971869 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:19.982076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4dc87356-c5e4-4db3-a08a-619469bfa109 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.322968 Jun 18 08:08:19.990455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 90/170] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:19 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:20.676927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:20.677779 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:20.688857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:20.688857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:20.688857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:20.688857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:20.878359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:20.885861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bbfc4fc6-2e44-481f-b82e-98b2bf05ceac tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1497 microversion: 2.1 time: 0.213695 Jun 18 08:08:20.886340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 81/171] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:20 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:20.946036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:20.946772 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:20.953951 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:20.954574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:20.955567 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:20.957350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.003064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:21.003877 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:21.014166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.014892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.015858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.017092 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.035119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:21.050698 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d9b15777-1847-4367-8e97-8bc726981d2e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1293 microversion: 2.1 time: 0.106544 Jun 18 08:08:21.051812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 91/172] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:20 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:21.192198 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:21.201723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bf9f52bf-b154-463e-81a5-252beee22348 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.206391 Jun 18 08:08:21.202916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 82/173] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:20 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:21.835806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:21.836515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:21.844292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.844741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.845496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.846076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.874619 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:08:21.968733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6a6dfc2f-7c85-42c1-b0e7-2e637e547852 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 204 len: 0 microversion: 2.1 time: 0.137461 Jun 18 08:08:21.969660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 92/174] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:08:21 2022] DELETE /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:08:21.979082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:21.979699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:21.987104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.987843 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:21.988782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:21.989216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:22.072675 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:22.074096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:22.082322 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:22.082880 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:22.083807 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:22.084323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:22.110332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:22.155273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:22.163467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b90a3e22-4115-4623-b086-65790a0fa087 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1503 microversion: 2.1 time: 0.189551 Jun 18 08:08:22.164449 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 83/175] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:21 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:22.174136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:22.182061 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d6d647e1-2f9d-437e-b4bc-c146adbafc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1293 microversion: 2.1 time: 0.115966 Jun 18 08:08:22.182640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 93/176] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:22 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:22.218967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:22.219735 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:22.226247 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:22.226901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:22.227718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:22.228153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:22.372069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:22.380265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5837cf5d-9d0f-4db3-962e-d778a1b729fb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.165171 Jun 18 08:08:22.381039 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 84/177] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:22 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:23.182834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:23.183620 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:23.191977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.192553 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.193484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.194216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.201586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:23.202596 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:23.210869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.211451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.212308 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.212807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.278032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:23.285628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-23b18c55-63d2-4f39-bdc5-ea30d341b276 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1293 microversion: 2.1 time: 0.089564 Jun 18 08:08:23.286542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 85/178] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:23 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:23.340904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:23.349146 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-686efac3-75bc-4c7d-8171-6df83d96d3b2 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1503 microversion: 2.1 time: 0.171697 Jun 18 08:08:23.349795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 94/179] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:23 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:23.398070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:23.398680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:23.405228 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.405676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.406439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:23.406866 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:23.541717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:23.549602 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1c304f6c-89fb-4954-a358-8a7a71cece53 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.155684 Jun 18 08:08:23.550163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 86/180] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:23 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:24.303631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:24.304307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:24.310525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.311228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.311998 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.312414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.366031 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:24.366773 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:24.373407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.373845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.374652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.375106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.392769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:24.401424 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0a4ff043-cd8f-44f8-8eb3-f35b50910f88 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1293 microversion: 2.1 time: 0.102797 Jun 18 08:08:24.402056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 95/181] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:24 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:24.522390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:24.531072 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e497cf07-d352-4c41-ae2f-e332759be50c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1503 microversion: 2.1 time: 0.168890 Jun 18 08:08:24.531848 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:24 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:24.566852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:24.567474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:24.573603 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.574036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.574779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:24.575224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:24.723033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:24.734211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d3740b5d-d5c2-4681-a70f-781ba7948c2c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.171490 Jun 18 08:08:24.734905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 96/183] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:24 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:25.423546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:25.424371 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:25.432815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.433749 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.435054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.435963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.551433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:25.553217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:25.555221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:25.567859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.568504 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.569631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.571384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.574417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:25.588058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2b222847-ea0e-417d-befd-8a8e443e20b2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1299 microversion: 2.1 time: 0.172630 Jun 18 08:08:25.591950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 88/184] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:25 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:25.662393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:25.663801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-fac71087-b366-425b-9064-f99e17d36f15 req-0bcaace9-38ec-4192-ab66-5de963bb08d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a182d61-1ad1-44c6-bd4d-9760d8f81f7a", "name": "network-vif-deleted", "tag": "afc1115b-1416-4009-ac86-e285426039a4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:25.684538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5d4e696-0d01-4362-8c9e-5099494a3aa6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1461 microversion: 2.1 time: 0.135467 Jun 18 08:08:25.685775 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fac71087-b366-425b-9064-f99e17d36f15 req-0bcaace9-38ec-4192-ab66-5de963bb08d7 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.686232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fac71087-b366-425b-9064-f99e17d36f15 req-0bcaace9-38ec-4192-ab66-5de963bb08d7 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.687786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 97/185] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:25 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1461 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:25.705376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-fac71087-b366-425b-9064-f99e17d36f15 req-0bcaace9-38ec-4192-ab66-5de963bb08d7 service nova] Creating event network-vif-deleted:afc1115b-1416-4009-ac86-e285426039a4 for instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a on hv-cinder-82634 Jun 18 08:08:25.713380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-fac71087-b366-425b-9064-f99e17d36f15 req-0bcaace9-38ec-4192-ab66-5de963bb08d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058394 Jun 18 08:08:25.717762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 89/186] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:25.750849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:25.751474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:25.757819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.758258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.759388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:25.760073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:25.904035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:25.911681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ad94cac3-d841-466d-a5f8-59a4b7172b2d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1520 microversion: 2.1 time: 0.165254 Jun 18 08:08:25.914818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 98/187] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:25 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:26.608845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:26.609710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:26.619729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.620487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.621526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.622185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.706961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:26.707665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:26.735082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.736775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.745627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.748953 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.853949 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.856308 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.857021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lazy-loading 'fault' on Instance uuid 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:08:26.927943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:26.958807 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:26.963283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:26.974019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a8ef9b80-0fc2-4c62-ab9a-2b4dc6901361 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.369101 Jun 18 08:08:26.975084 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 90/188] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:26 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:26.979334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b778355c-f2e5-4ccb-9942-40749b75864d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 200 len: 1303 microversion: 2.1 time: 0.278040 Jun 18 08:08:26.980575 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:26.981760 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:26.989706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.989868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 99/189] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:26 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:26.990439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:26.991369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:26.991990 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:27.147314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:27.155025 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-edb54c9f-f066-4fcf-a597-01eadb0dc993 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1500 microversion: 2.1 time: 0.178740 Jun 18 08:08:27.155586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 91/190] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:26 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:27.170957 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:27.171599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:27.177720 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:27.178139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:27.178933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:27.179389 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:27.336633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:27.346325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8bc4d9cd-f144-4d42-8406-eba2008437b7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1514 microversion: 2.1 time: 0.179173 Jun 18 08:08:27.346906 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 100/191] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:27 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:27.996607 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:27.997344 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:27.997935 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:27.998329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:28.008194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.009206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.010073 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.011454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.020398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.022148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.023469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.025195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.071292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] HTTP exception thrown: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Request method failure captured: Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a HTTP/1.1 Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfaZBsU6rnTOH2Q6_J4T6bgb5UUQvJXmct_ecxsDl5vKDBnjv1wnRhpjScXPboq2Ss19v51Texlg2pt0UHoLH9raD9Zs9ht8gnf0plDtWiNdVNjRvIz2gchHQ3SavBJoW2Ilma1UuSmuyW_KzT7PYE1l5XezIHLnA_EgdJew5xk9lg Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 7fc3f6aac547489fa25a163e016f8eef Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesActionsTest-599769028 Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:08:28.077341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fc3f6aac547489fa25a163e016f8eef", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesActionsTest-599769028 Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7fc3f6aac547489fa25a163e016f8eef Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesActionsTest-599769028 Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesActionsTest-599769028-project Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: b2e98667ae014396bd1b2e04533037be Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesActionsTest-599769028-project Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. Jun 18 08:08:28.078843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '3a182d61-1ad1-44c6-bd4d-9760d8f81f7a'} Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:28.079812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. Jun 18 08:08:28.081288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:08:28.082364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Returning 404 to user: Instance 3a182d61-1ad1-44c6-bd4d-9760d8f81f7a could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:28.082364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0de14212-8278-4346-823f-fc45cbafe966 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a" status: 404 len: 111 microversion: 2.1 time: 0.086502 Jun 18 08:08:28.082364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 101/192] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:27 2022] GET /compute/v2.1/servers/3a182d61-1ad1-44c6-bd4d-9760d8f81f7a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 08:08:28.301217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-195616252", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "networks": [{"uuid": "fbf69721-c844-426f-8a34-466c5ae8bd57"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:28.387337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] validate_networks() for [('fbf69721-c844-426f-8a34-466c5ae8bd57', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:08:28.389389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:28.413331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6a19f6f1-f047-4619-8325-c3a5ba82b59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.426253 Jun 18 08:08:28.414580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 92/193] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:27 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:28.537920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-1a4afc8d-ea23-447c-84fc-073e43e43ecf req-79269a64-680f-4262-8dd6-2940db209f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b729a844-3a58-4b1a-9d49-bb4aa97773e6", "tag": "cc1e7c56-27e8-4f1c-8c35-238d6c80f431"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:28.575207 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1a4afc8d-ea23-447c-84fc-073e43e43ecf req-79269a64-680f-4262-8dd6-2940db209f92 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.575824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1a4afc8d-ea23-447c-84fc-073e43e43ecf req-79269a64-680f-4262-8dd6-2940db209f92 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.623978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-1a4afc8d-ea23-447c-84fc-073e43e43ecf req-79269a64-680f-4262-8dd6-2940db209f92 service nova] Creating event network-changed:cc1e7c56-27e8-4f1c-8c35-238d6c80f431 for instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 on hv-cinder-82634 Jun 18 08:08:28.636721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-1a4afc8d-ea23-447c-84fc-073e43e43ecf req-79269a64-680f-4262-8dd6-2940db209f92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109714 Jun 18 08:08:28.642104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 93/194] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:28.945690 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:08:28.946461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:08:28.947167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:08:28.947780 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:08:28.948376 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:08:28.960057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:28.961004 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:28.961896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.962565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.963590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.964550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.973717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.976574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.977534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:28.982332 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:28.985608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Getting quotas for project 7fc3f6aac547489fa25a163e016f8eef. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:08:28.990357 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Getting quotas for user b2e98667ae014396bd1b2e04533037be and project 7fc3f6aac547489fa25a163e016f8eef. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:08:29.005321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:08:29.007896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:08:29.112357 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae563f99-a3ee-4395-b974-276faac6dc4d tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814600 Jun 18 08:08:29.113055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 102/195] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:08:29.125133 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ca498846-a499-41b3-b471-8b7572fbcdcd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:29.149242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ca498846-a499-41b3-b471-8b7572fbcdcd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:29.211156 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca498846-a499-41b3-b471-8b7572fbcdcd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:29.219904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ca498846-a499-41b3-b471-8b7572fbcdcd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1213 microversion: 2.1 time: 0.100149 Jun 18 08:08:29.221451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 103/196] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:29 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:29.231636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'flavor' on Instance uuid 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:08:29.284937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:29.315081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51fafd74-5cc8-443c-b19d-98a18fb29f6a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/action" status: 200 len: 32 microversion: 2.1 time: 0.359325 Jun 18 08:08:29.319063 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 94/197] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:08:28 2022] POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 08:08:29.325129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:29.325859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:29.332777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:29.333288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:29.334119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:29.334610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:29.430781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:29.431520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:29.438385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:29.438827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:29.440108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:29.440579 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:29.467101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:29.475067 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5aa7a710-6e08-4f01-8060-b29488b94e73 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.153886 Jun 18 08:08:29.475797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 104/198] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:29 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:29.581911 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:29.589899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b93af340-dcee-43b7-9e4a-33b9c55d4e18 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.163497 Jun 18 08:08:29.590914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 95/199] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:29 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:30.124808 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1829739092", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "networks": [{"uuid": "34728dbd-466c-4060-9c86-3143df93aca9"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:30.175359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] validate_networks() for [('34728dbd-466c-4060-9c86-3143df93aca9', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:08:30.237726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:30.238447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:30.240442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:30.241095 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:30.247751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.248192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.249089 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.249503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.310761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:30.318701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f8e2bc04-b79c-4ce4-8775-425448440bcc tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1217 microversion: 2.1 time: 0.084912 Jun 18 08:08:30.319772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 96/200] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:30 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:30.493177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:30.493776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:30.500218 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.500662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.501443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.501837 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.530839 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:08:30.531283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:08:30.531766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:08:30.532157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:08:30.532558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:08:30.541291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.541721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.543120 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.543120 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.563843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Getting quotas for project c53dba3c495141569fc1a011b51023b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:08:30.568611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Getting quotas for user c918c712ffb945f3b21bd76de9f22115 and project c53dba3c495141569fc1a011b51023b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:08:30.580385 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:08:30.582493 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:08:30.631664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ea872875-1f94-453f-833e-86c5ff79d652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510426 Jun 18 08:08:30.637791 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 105/201] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:08:30.638869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:30.642655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:30.643239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:30.649690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-63f9cc90-da99-486c-ad00-25d3d3a0f316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.160009 Jun 18 08:08:30.649835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.650138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.650804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 97/202] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:30 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:30.650908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:30.655587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:30.657069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db397655-e572-400b-a5cb-613d9cb06586 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:30.657845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db397655-e572-400b-a5cb-613d9cb06586 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:30.714380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db397655-e572-400b-a5cb-613d9cb06586 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:30.722773 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db397655-e572-400b-a5cb-613d9cb06586 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1219 microversion: 2.1 time: 0.070702 Jun 18 08:08:30.723435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 98/203] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:30 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:30.793008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:30.800714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-15baf471-4e22-4d76-a304-239cf391a029 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.161815 Jun 18 08:08:30.801368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 106/204] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:30 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:31.338324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:31.338938 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:31.346126 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.346572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.347383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.347819 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.414145 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:31.422078 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33f3d7f9-b4e6-44b0-acc7-30d17a2c5e02 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1217 microversion: 2.1 time: 0.088570 Jun 18 08:08:31.422652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 99/205] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:31 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:31.671757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:31.672692 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:31.682855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.683644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.684877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.685586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.740111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:31.740714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:31.747897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.748314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.749075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.749505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.811864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:31.820614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:31.820931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4fdd6486-b8fc-4d0e-a6e9-85387717b1ad tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1223 microversion: 2.1 time: 0.084710 Jun 18 08:08:31.821500 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 100/206] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:31 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:31.830518 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:31.830518 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:31.830705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-01d54f61-b704-4386-9297-0bfaae8695ad tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.163426 Jun 18 08:08:31.830705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 107/207] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:31 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:31.832428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.832836 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.833589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:31.834009 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:31.962506 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:31.970661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f71e7fde-5f6b-4cda-8c1f-4b03fa2a28be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.148231 Jun 18 08:08:31.971263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 101/208] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:31 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:32.440039 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:32.440634 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:32.447196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.447634 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.448364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.449181 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.509041 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:32.516604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e60fc478-f6cc-4c16-9847-2a86b9e3acbf tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1217 microversion: 2.1 time: 0.081200 Jun 18 08:08:32.517165 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 108/209] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:32 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:32.838024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:32.838615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:32.845454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.845620 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:32.846024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.846114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:32.846642 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.847080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.852618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.853057 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.853831 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:32.854252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:32.911931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:32.920085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fd5b3a69-bf51-4692-8c35-b183734ca035 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1223 microversion: 2.1 time: 0.086110 Jun 18 08:08:32.920673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 102/210] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:32 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:32.989301 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:32.990954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:32.993720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:33.012343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.012791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:33.013702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.014126 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:33.019898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:33.029083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5009a509-f1df-4279-85aa-011cf4d76500 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.187194 Jun 18 08:08:33.031958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 109/211] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:32 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:33.534121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:33.540482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:33.543177 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.543759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:33.545391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.546094 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:33.565676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:33.577917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b0b7f440-07e3-4460-b588-e9d0c62ae50a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.593559 Jun 18 08:08:33.583576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 103/212] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:32 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:33.615994 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:33.623555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c8d77021-c1a5-4db6-9fe7-76dc2974ccf3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1265 microversion: 2.1 time: 0.093685 Jun 18 08:08:33.624126 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 110/213] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:33 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:33.937516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:33.938192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:33.946372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.947162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:33.948238 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:33.948665 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.047972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:34.049448 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:34.056516 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.057278 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.058318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.059080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.076942 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:34.090027 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5daa2c33-4a4a-4828-b64e-64b31663ff67 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1271 microversion: 2.1 time: 0.156265 Jun 18 08:08:34.091440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 104/214] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:33 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:34.225536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:34.237928 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0aa3553d-7f3e-4567-8090-3e1096c38111 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.192911 Jun 18 08:08:34.238816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:34 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:34.599483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:34.600104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:34.608431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.609060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.609970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.610560 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.640203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:34.640829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:34.650863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.651461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.652228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:34.652655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:34.683544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:34.732075 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:34.741897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c50c22ac-0375-405c-ba3c-2b8fd0aaa66c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1271 microversion: 2.1 time: 0.106104 Jun 18 08:08:34.742476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 112/216] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:34 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:35.108058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:35.108667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:35.110984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:35.115104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.115545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.116447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.116916 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.119235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a014f4b-41f6-4ca5-95f0-5bee2f8a6572 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.525426 Jun 18 08:08:35.120196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 105/217] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:34 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:35.186715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:35.194865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b8337ba9-db1d-4f58-96ac-0fe3182620c8 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1277 microversion: 2.1 time: 0.090916 Jun 18 08:08:35.195547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 113/218] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:35 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:35.255137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:35.255774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:35.262157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.262629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.263444 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.264068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.628312 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:35.637424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-73edb028-c29e-41a6-93cb-a7d841bce911 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.386089 Jun 18 08:08:35.638225 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 106/219] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:35 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:35.763444 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:35.764423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:35.778042 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.779560 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.787463 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.788027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.820035 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-4e555acf-f748-44b4-8e70-3f435ea7e7bd req-79bcef68-e2b9-4bf9-88aa-af7e7dcfd99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b729a844-3a58-4b1a-9d49-bb4aa97773e6", "name": "network-vif-plugged", "status": "completed", "tag": "cc1e7c56-27e8-4f1c-8c35-238d6c80f431"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:35.838745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4e555acf-f748-44b4-8e70-3f435ea7e7bd req-79bcef68-e2b9-4bf9-88aa-af7e7dcfd99a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:35.841107 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4e555acf-f748-44b4-8e70-3f435ea7e7bd req-79bcef68-e2b9-4bf9-88aa-af7e7dcfd99a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:35.874274 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-4e555acf-f748-44b4-8e70-3f435ea7e7bd req-79bcef68-e2b9-4bf9-88aa-af7e7dcfd99a service nova] Creating event network-vif-plugged:cc1e7c56-27e8-4f1c-8c35-238d6c80f431 for instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 on hv-cinder-82634 Jun 18 08:08:35.888081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-4e555acf-f748-44b4-8e70-3f435ea7e7bd req-79bcef68-e2b9-4bf9-88aa-af7e7dcfd99a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072490 Jun 18 08:08:35.891910 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 107/220] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:08:35.932353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:35.941315 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-52c8f74d-88ba-4aa3-a0a7-855b55da795c tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1271 microversion: 2.1 time: 0.183702 Jun 18 08:08:35.941913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 114/221] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:35 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:36.138029 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:36.138753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:36.145227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.145724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.146453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.146883 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.212849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:36.214136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:36.221322 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.221761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.222556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.222979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.362872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:36.370897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93c30a57-b9d9-48f0-83d8-6f5922e43c35 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.162096 Jun 18 08:08:36.371541 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 115/222] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:36 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:36.654093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:36.654771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:36.661060 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.661501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.662246 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.662672 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.736108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:36.744199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44c801a9-835d-466d-926d-fc493e5c5139 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.611032 Jun 18 08:08:36.745192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 108/223] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:36 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:36.800198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:36.807837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ad4e3b3-0a5b-4590-9ecf-a2db96ec0c41 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.157803 Jun 18 08:08:36.809326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 116/224] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:36 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:36.958281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:36.958956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:36.965633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.966179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:36.967033 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:36.967557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.278303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:37.286744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7a579c8e-f425-4157-aac7-56417c430a0e tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.332498 Jun 18 08:08:37.287362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 109/225] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:36 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:37.388528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:37.389140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:37.396343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.396791 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.397813 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.398247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.537458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:37.545489 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5671665c-a9fb-4e3e-b178-f3cdbe7d3917 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.160953 Jun 18 08:08:37.550920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:37 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:37.751075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-a4c8ccc9-cf41-4d25-96ad-4739a2ae3b9a req-e3d104c6-26a3-4ac3-8405-179dd575405d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f9ffdf-2433-43da-a089-ebd0c80d8469", "tag": "ad0be532-4c7a-4527-85ca-0a6997ea08af"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:37.760474 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a4c8ccc9-cf41-4d25-96ad-4739a2ae3b9a req-e3d104c6-26a3-4ac3-8405-179dd575405d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.760847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a4c8ccc9-cf41-4d25-96ad-4739a2ae3b9a req-e3d104c6-26a3-4ac3-8405-179dd575405d service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.761829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:37.762435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:37.769029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.769996 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.770900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.771550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.773110 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-a4c8ccc9-cf41-4d25-96ad-4739a2ae3b9a req-e3d104c6-26a3-4ac3-8405-179dd575405d service nova] Creating event network-changed:ad0be532-4c7a-4527-85ca-0a6997ea08af for instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 on hv-cinder-82634 Jun 18 08:08:37.784968 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-a4c8ccc9-cf41-4d25-96ad-4739a2ae3b9a req-e3d104c6-26a3-4ac3-8405-179dd575405d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038018 Jun 18 08:08:37.786216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 110/227] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:37.827376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:37.828250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:37.836109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.836564 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.837321 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:37.837747 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:37.906058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:37.913679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-80081dd8-0887-41d3-af9d-c3a06988c7a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.156048 Jun 18 08:08:37.914264 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 118/228] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:37 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:37.969782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:37.982339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5afa957a-593c-48c1-b3a2-4318b74a0e5a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.159752 Jun 18 08:08:37.983785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 111/229] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:37 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:38.308162 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:38.309405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:38.319689 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.320133 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.320882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.321431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.455613 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:38.467239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7dfed0b1-689f-4a4e-925a-13b36b3389c5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.165438 Jun 18 08:08:38.468177 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 119/230] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:38 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:38.565893 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:38.566576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:38.574480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.574921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.575700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.576157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.720195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:38.728082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-10989d48-97f4-4486-8730-2f65b113b751 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.168971 Jun 18 08:08:38.728638 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 112/231] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:38 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:38.935861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:38.936842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:38.947505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.948225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.949453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:38.950147 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:38.999812 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:39.000404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:39.006507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.006998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.007771 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.008204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.012353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:39.083486 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:39.091512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-efe8a78d-0daa-4fba-a70d-79ddda7bca24 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.163387 Jun 18 08:08:39.092092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 120/232] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:38 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:39.141963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:39.154326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ef21549d-ec1a-4cc3-a0df-547791c4f831 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.158087 Jun 18 08:08:39.155205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:38 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:39.488037 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:39.489134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:39.496412 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.496853 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.497604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.498020 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.634236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:39.642666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b8aa27d5-05a5-40d8-a496-2c7c7b85a053 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.160776 Jun 18 08:08:39.643293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:39 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:39.748491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:39.749293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:39.758827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.759339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.760088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.760530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.831422 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-1bb8457f-df06-4136-929a-f4e5e37c281a req-4d27f7ff-3ad1-4c2f-a547-fd4536799b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78bbd92-5f1f-46c5-aab5-856f06c90382", "tag": "b9ad9cab-6619-4942-a04b-ca380f88f089"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:39.840226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1bb8457f-df06-4136-929a-f4e5e37c281a req-4d27f7ff-3ad1-4c2f-a547-fd4536799b5b service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:39.840671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1bb8457f-df06-4136-929a-f4e5e37c281a req-4d27f7ff-3ad1-4c2f-a547-fd4536799b5b service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:39.852046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-1bb8457f-df06-4136-929a-f4e5e37c281a req-4d27f7ff-3ad1-4c2f-a547-fd4536799b5b service nova] Creating event network-changed:b9ad9cab-6619-4942-a04b-ca380f88f089 for instance f78bbd92-5f1f-46c5-aab5-856f06c90382 on hv-cinder-82634 Jun 18 08:08:39.857581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-1bb8457f-df06-4136-929a-f4e5e37c281a req-4d27f7ff-3ad1-4c2f-a547-fd4536799b5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029703 Jun 18 08:08:39.858201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 122/235] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:08:39.903574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:39.911410 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-116bdbff-e29e-4db4-be5c-a0a1dcfa5744 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.168988 Jun 18 08:08:39.911979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 114/236] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:39 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:40.109157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:40.109845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:40.116544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.116983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.117746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.118223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.171465 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:40.172067 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:40.177970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.178417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.179272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.179707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.251954 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:40.260857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ca987d4c-907f-4c6f-a2d5-de20ae492184 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1367 microversion: 2.1 time: 0.155862 Jun 18 08:08:40.262401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:40 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:40.457221 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:40.466577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e1fe2206-cfab-4f72-acc7-15325c57d61c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.298944 Jun 18 08:08:40.467302 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 115/238] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:40 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:40.661189 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:40.661788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:40.664208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:40.664858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=14 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:40.674310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.674746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.675533 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.675918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.772198 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:40.772749 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:40.777191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:40.787156 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.787634 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.788476 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.788905 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.821842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-95b42ce8-e462-4acf-9d15-c0337185a354 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/ips" status: 200 len: 144 microversion: 2.1 time: 0.053426 Jun 18 08:08:40.822435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 116/239] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:08:40 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/ips => generated 144 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:40.853727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:40.861275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-119dec84-44ff-4998-b0a1-87977b64c141 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.204008 Jun 18 08:08:40.862029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 124/240] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:40 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:40.929267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:40.929873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:40.936360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.936830 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:40.937641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:40.938088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.087139 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:41.094895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-962f8c21-c05b-4d94-ae92-5cea88296c86 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.169725 Jun 18 08:08:41.095498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 117/241] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:40 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:41.278199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:41.278719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:41.288185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.288634 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.289462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.289980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.434886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:41.443058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-34271874-f46e-4e0d-a4fa-59fe5eb95670 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1558 microversion: 2.1 time: 0.168932 Jun 18 08:08:41.443921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 125/242] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:41 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:41.460435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:41.460924 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:41.466966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.467440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.468189 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.468607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.483799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:41.484495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:41.490896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.491492 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.492363 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.492863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.623382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:41.627802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f4bb9c9d-b94b-4da5-a1a8-de7c0d446303 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171468 Jun 18 08:08:41.628403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 118/243] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:08:41 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:41.634240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-95f41f65-6dc1-4ed7-a9db-9c0322832077 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.151527 Jun 18 08:08:41.634240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 126/244] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:41 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:41.877795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:41.879349 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:41.885825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.886257 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:41.887196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:41.887613 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.114811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:42.115592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:42.122542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:42.122987 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.124206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:42.124719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.148452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:42.157803 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cac43229-ede8-4452-a42b-b43e4d40e4a6 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.283847 Jun 18 08:08:42.171299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 127/245] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:41 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:42.285253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:42.293706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7268e073-4a93-4cd5-b1c3-ecd1cb23093e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.185144 Jun 18 08:08:42.303427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 119/246] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:42 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:42.648944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:42.649532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:42.656368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:42.656811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.657572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:42.657996 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.862719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:42.870351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bbe53438-c568-422b-9021-f8d12663578b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.225423 Jun 18 08:08:42.870904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 128/247] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:42 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:42.965538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c34d8855-6e28-41c4-ae8b-4865f54429a3 req-07c665e6-a964-433c-831a-48f1e21dc3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b729a844-3a58-4b1a-9d49-bb4aa97773e6", "tag": "cc1e7c56-27e8-4f1c-8c35-238d6c80f431"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:42.974766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c34d8855-6e28-41c4-ae8b-4865f54429a3 req-07c665e6-a964-433c-831a-48f1e21dc3ec service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:42.975601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c34d8855-6e28-41c4-ae8b-4865f54429a3 req-07c665e6-a964-433c-831a-48f1e21dc3ec service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:42.989700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c34d8855-6e28-41c4-ae8b-4865f54429a3 req-07c665e6-a964-433c-831a-48f1e21dc3ec service nova] Creating event network-changed:cc1e7c56-27e8-4f1c-8c35-238d6c80f431 for instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 on hv-cinder-82634 Jun 18 08:08:42.994748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c34d8855-6e28-41c4-ae8b-4865f54429a3 req-07c665e6-a964-433c-831a-48f1e21dc3ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033379 Jun 18 08:08:42.995702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 120/248] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:43.175605 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:43.176208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:43.182367 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.182806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.183655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.184345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.310932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:43.312412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:43.320466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.321276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.322440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.323123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.323260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:43.326695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:43.332834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8d121c3-70bf-41fb-abbd-1288ed56e0d3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.161159 Jun 18 08:08:43.334293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 129/249] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:43 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:43.496080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9934e46-1b95-43f0-b002-b9be43357fe8"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:43.497487 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:43.504301 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.504835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.505772 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.506760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.704869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:43.713964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-39a57ff5-42ad-40c5-a469-df82f0fd3ef5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.407834 Jun 18 08:08:43.714799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 121/250] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:43 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:43.888132 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:43.889953 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:43.905760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bf74647f-137d-4817-93d8-018f8c534175 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413894 Jun 18 08:08:43.908786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.909365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.910209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:43.910639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:43.912419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 130/251] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:08:43 2022] POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:08:44.236527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:44.244595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-152683ff-d3d7-4f60-acc0-3465528b1f48 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.360461 Jun 18 08:08:44.245404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 122/252] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:43 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:44.351260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:44.352124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:44.358068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:44.360028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:44.360671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:44.361469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:44.361955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:44.502437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:44.511937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d3ddc896-21f6-46ac-a9d6-007632d4c7b3 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.165934 Jun 18 08:08:44.512835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:44 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:44.734309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:44.734950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:44.743606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:44.744050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:44.744774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:44.745528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:44.875179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:44.883003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-112bba48-6e52-45dd-934a-894ffbaef2be tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.154528 Jun 18 08:08:44.883481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:44 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:45.162504 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:45.163160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:45.169621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.170073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.172178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.172727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.221098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ce13601c-3e18-4ba2-bd23-a539fa97f259 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/ips" status: 200 len: 151 microversion: 2.20 time: 0.062690 Jun 18 08:08:45.222386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 132/255] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Jun 18 08:08:45 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/ips => generated 151 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:08:45.261814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:45.262853 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:45.272379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.281906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.282963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.285172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.455309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:45.464133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a7e09168-f2d0-4736-a58b-4f289bcf5ddd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.206314 Jun 18 08:08:45.465383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 124/256] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:45 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:45.539922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:45.548450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:45.556286 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.556876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.558122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.558783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.702895 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:45.710446 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2aa56bfa-626b-46de-b68f-098a7da946d5 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.185173 Jun 18 08:08:45.711367 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 133/257] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:45 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:45.899946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:45.900722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:45.909241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.909686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:45.910446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:45.910873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.052204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:46.060236 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-05733818-fcd2-49be-9ec6-2505203c959d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.164361 Jun 18 08:08:46.060796 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:45 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:46.115392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-78154597-a4c0-4532-abea-8947c3b75652 req-e86490ce-6c6d-476a-b4f9-d7f4b9ff7b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78bbd92-5f1f-46c5-aab5-856f06c90382", "name": "network-vif-plugged", "status": "completed", "tag": "b9ad9cab-6619-4942-a04b-ca380f88f089"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:46.125080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-78154597-a4c0-4532-abea-8947c3b75652 req-e86490ce-6c6d-476a-b4f9-d7f4b9ff7b59 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:46.125546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-78154597-a4c0-4532-abea-8947c3b75652 req-e86490ce-6c6d-476a-b4f9-d7f4b9ff7b59 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.139901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-78154597-a4c0-4532-abea-8947c3b75652 req-e86490ce-6c6d-476a-b4f9-d7f4b9ff7b59 service nova] Creating event network-vif-plugged:b9ad9cab-6619-4942-a04b-ca380f88f089 for instance f78bbd92-5f1f-46c5-aab5-856f06c90382 on hv-cinder-82634 Jun 18 08:08:46.145222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-78154597-a4c0-4532-abea-8947c3b75652 req-e86490ce-6c6d-476a-b4f9-d7f4b9ff7b59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Jun 18 08:08:46.146076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 134/259] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:46.481384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:46.481989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:46.488228 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:46.488676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.489427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:46.489846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.626304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:46.635880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c8d515f-beae-4784-897b-fabd0b23d0c7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.158099 Jun 18 08:08:46.637361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 126/260] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:46 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:46.729340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:46.730051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:46.737184 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:46.737626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.738373 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:46.738791 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:46.871279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:46.878902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a3552a68-0354-47ff-a4f4-77e9c18aa144 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.154429 Jun 18 08:08:46.879480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 135/261] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:46 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:47.080259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:47.081052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:47.089292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.089789 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:47.090543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.090991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:47.222786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:47.230742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0b4cb0f0-020b-4173-ab1e-50874ebf4bea tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.155749 Jun 18 08:08:47.231376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 127/262] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:47 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:47.654651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:47.655312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:47.662329 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.662800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:47.663785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.664267 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:47.815574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:47.823617 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-13ce2def-222c-45ff-9696-b2643b817a3a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.173105 Jun 18 08:08:47.824263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 136/263] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:47 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:47.896414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:47.897004 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:47.903304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.903987 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:47.904769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:47.905403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.045281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:48.056858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cc297ca-74ed-45e9-a13f-2db38404ae49 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.164208 Jun 18 08:08:48.057578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:47 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:48.093477 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:48.094192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:48.103103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.103551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.104296 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.104742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.129035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lazy-loading 'flavor' on Instance uuid ab6e7d6f-1ab3-489b-938f-60eed0962e00 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:08:48.162345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-347f9342-5803-4991-a453-af8ac10eb151 req-fb51354c-cad8-4c75-ba0e-011fb48aede3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f9ffdf-2433-43da-a089-ebd0c80d8469", "name": "network-vif-plugged", "status": "completed", "tag": "ad0be532-4c7a-4527-85ca-0a6997ea08af"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:48.173342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-347f9342-5803-4991-a453-af8ac10eb151 req-fb51354c-cad8-4c75-ba0e-011fb48aede3 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.173772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-347f9342-5803-4991-a453-af8ac10eb151 req-fb51354c-cad8-4c75-ba0e-011fb48aede3 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.185844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-347f9342-5803-4991-a453-af8ac10eb151 req-fb51354c-cad8-4c75-ba0e-011fb48aede3 service nova] Creating event network-vif-plugged:ad0be532-4c7a-4527-85ca-0a6997ea08af for instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 on hv-cinder-82634 Jun 18 08:08:48.191831 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-347f9342-5803-4991-a453-af8ac10eb151 req-fb51354c-cad8-4c75-ba0e-011fb48aede3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Jun 18 08:08:48.192681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 129/265] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:08:48.252798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:48.253772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:48.260835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.261395 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.262165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.262729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.408770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:48.416805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7d5377a-4175-40c4-8872-b6fc9f830849 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1319 microversion: 2.1 time: 0.171857 Jun 18 08:08:48.417459 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 130/266] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:48 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:48.462351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-70a4450a-7b85-40e6-b063-0c1982836d59 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/action" status: 202 len: 0 microversion: 2.20 time: 0.374001 Jun 18 08:08:48.462997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 137/267] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 08:08:48 2022] POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:08:48.471389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:48.471986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:48.478380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.478818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.479696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.480114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.633319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:48.637092 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:48.642961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:48.644742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:48.646197 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9a65fb55-d245-443c-a83c-37b9491ba713 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.178607 Jun 18 08:08:48.647083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 131/268] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:48 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:48.841942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:48.842618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:48.849425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.849872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.850962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:48.851473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:48.992145 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.001517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-488e3bc1-a64c-444e-ae73-5bc0297bb664 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.164457 Jun 18 08:08:49.002115 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 138/269] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:48 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:49.078701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:49.079324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:49.086675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.087179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.087933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.088355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.238588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.246924 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-85d2878c-a092-4874-af21-db935723d959 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.172103 Jun 18 08:08:49.247661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 132/270] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:49 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:49.437020 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:49.437842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:49.447750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.448476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.449641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.450247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.590266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.598065 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4204fd5c-83f9-41e0-b273-ee61daadb2cd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1508 microversion: 2.1 time: 0.166961 Jun 18 08:08:49.598648 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 139/271] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:49 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:49.666705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:49.667380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:49.674557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.674933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.675771 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:49.676205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:49.814752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.824163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.827203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:49.828465 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17f8341d-53fd-40c0-b969-d59871354507 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.166029 Jun 18 08:08:49.830230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 133/272] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:49 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:08:50.022768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:50.023793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:50.031555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.032077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.032916 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.033418 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.178849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:50.190950 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-67a82b11-2915-49ab-ba4e-0636b8d03c34 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.176881 Jun 18 08:08:50.191865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 140/273] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:50 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:50.267566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:50.268438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:50.279158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.279863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.281012 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.281677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.419972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:50.427564 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-47836c41-1ded-45d7-bba7-ebbdd82f8566 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1313 microversion: 2.1 time: 0.166144 Jun 18 08:08:50.428178 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 134/274] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:50 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:50.848298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:50.848901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:50.855444 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.855887 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.856640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:50.857066 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:50.992104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:51.002735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:51.004525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:51.006189 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73025f7b-54ff-46ee-a677-4375f52767ee tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.161776 Jun 18 08:08:51.006931 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 141/275] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:50 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:08:51.215362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:51.216146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:51.225827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:51.226262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:51.227153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:51.227574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:51.374471 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:51.382520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-abec9e08-bc82-4082-b258-f1bed842949a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.173232 Jun 18 08:08:51.383089 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 135/276] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:51 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:51.447204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:51.447796 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:51.457741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:51.458411 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:51.459222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:51.459644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:51.604432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:51.612416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1307241-5eb2-4602-8dbf-f026edbb0165 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1497 microversion: 2.1 time: 0.170239 Jun 18 08:08:51.612996 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 142/277] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:51 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:52.024505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:52.025172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:52.031721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.032183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.032951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.033379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.163842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:52.171977 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:52.173485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:52.174627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0a8bfd02-d20b-4f0f-b170-8afb5135b56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.154161 Jun 18 08:08:52.175429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 136/278] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:52 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:52.291930 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:52.292580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:52.299200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.299634 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.300367 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.300783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.400758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:52.401469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:52.408839 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.409287 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.410054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.410483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.472223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:08:52.486942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:52.575100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8248aeb-634c-4ee6-a86e-baecc1b505a0 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 204 len: 0 microversion: 2.1 time: 0.286780 Jun 18 08:08:52.579359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 143/279] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:08:52 2022] DELETE /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:08:52.584704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:52.585476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:52.591451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.591896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.592457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:52.592654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:52.593075 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:52.602494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3111c97a-b1f7-4636-8119-bcfacad2489c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.206316 Jun 18 08:08:52.603935 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 137/280] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:52 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:52.727670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:52.739624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-76835d21-2fc8-4810-a406-ab36fd695012 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1503 microversion: 2.1 time: 0.158161 Jun 18 08:08:52.741302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 144/281] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:52 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:53.200093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:53.200735 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:53.207824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.208265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.208991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.209436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.348707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.357122 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.358578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.359762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86bac86b-b80b-44be-acff-59ab34ce6474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.163857 Jun 18 08:08:53.360330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 138/282] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:53 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:53.619167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-714bc5b9-da09-451a-9479-72a9ca23bce3 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:53.619725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:53.620435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:53.626140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-714bc5b9-da09-451a-9479-72a9ca23bce3 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.626554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-714bc5b9-da09-451a-9479-72a9ca23bce3 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.626826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.627303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.628060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.628512 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.687370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-714bc5b9-da09-451a-9479-72a9ca23bce3 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 08:08:53.736136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-714bc5b9-da09-451a-9479-72a9ca23bce3 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.121082 Jun 18 08:08:53.736757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 145/283] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:08:53 2022] POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:08:53.745402 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:53.746175 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:53.752750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.753205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.753962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.754392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.762508 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.770147 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13af02c6-c22b-4bb0-994b-54d2fdd6c2ea tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.154282 Jun 18 08:08:53.770762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 139/284] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:53 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:53.775211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:53.775806 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:53.781490 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.781918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.782641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:53.783077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:53.892287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.900493 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-785e24dd-07c7-4e61-a90d-22a1f21ad30b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.159399 Jun 18 08:08:53.901272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 146/285] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:53 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:53.919263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:53.926985 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-26a7e3b7-fb8d-4235-b03e-b82251477bdd tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1503 microversion: 2.1 time: 0.155243 Jun 18 08:08:53.927585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 140/286] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:53 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:54.380325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:54.381063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:54.389259 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.389727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.390722 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.391209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.534552 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:54.546394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:54.548995 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:54.550833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b000a51-6586-4be5-a415-8da904f4e403 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.176155 Jun 18 08:08:54.552190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 147/287] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:54 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:54.790431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:54.791137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:54.798501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.798959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.799801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.800222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.918114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:54.918765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:54.925890 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.926337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.927127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:54.927551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:54.978548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:54.986649 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35cbe250-fd63-40b1-9624-d6a0ecb308fe tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.202144 Jun 18 08:08:54.987380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 141/288] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:54 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:54.992408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:54.993174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:55.000608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:55.001088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:55.001856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:55.002754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:55.073984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:55.082955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-41fc19c9-aa04-4e5a-b769-0b40af74ffeb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.168937 Jun 18 08:08:55.084130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 148/289] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:54 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:55.250957 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:55.259101 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eed19aa4-8889-4425-b0cd-e7e738b2f79f tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1503 microversion: 2.1 time: 0.270488 Jun 18 08:08:55.259888 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 142/290] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:54 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:55.570406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:55.571208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:55.578067 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:55.578603 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:55.579478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:55.580008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:55.672353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c443c84d-616a-4f91-bc52-55056a82b78a req-36a9abc9-9c15-4647-b1dc-d0fa023267c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f9ffdf-2433-43da-a089-ebd0c80d8469", "name": "network-vif-deleted", "tag": "ad0be532-4c7a-4527-85ca-0a6997ea08af"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:08:55.681832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c443c84d-616a-4f91-bc52-55056a82b78a req-36a9abc9-9c15-4647-b1dc-d0fa023267c5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:55.682592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c443c84d-616a-4f91-bc52-55056a82b78a req-36a9abc9-9c15-4647-b1dc-d0fa023267c5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:55.696550 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c443c84d-616a-4f91-bc52-55056a82b78a req-36a9abc9-9c15-4647-b1dc-d0fa023267c5 service nova] Creating event network-vif-deleted:ad0be532-4c7a-4527-85ca-0a6997ea08af for instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 on hv-cinder-82634 Jun 18 08:08:55.702119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c443c84d-616a-4f91-bc52-55056a82b78a req-36a9abc9-9c15-4647-b1dc-d0fa023267c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033323 Jun 18 08:08:55.702889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 143/291] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:08:55.741330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:55.750125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:55.751833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:55.753118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-264ee029-b5a9-4b48-ac82-622aaf19ccf8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.186844 Jun 18 08:08:55.765574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 149/292] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:55 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:56.004475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:56.005105 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:56.012559 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.012998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.013756 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.014190 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.101542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:56.102194 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:56.108480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.109147 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.110077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.110508 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.151928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.159992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-07024bbb-c219-4217-a794-fcf8eb5b7102 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.159682 Jun 18 08:08:56.160689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 144/293] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:55 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:56.269879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.284071 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:56.285428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:56.295504 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be063bab-6bf6-46eb-b555-c462df5fe89f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.197657 Jun 18 08:08:56.296483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 150/294] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:56 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:56.303052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.303384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.304205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.304641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.355379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.355712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.356188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lazy-loading 'fault' on Instance uuid d6f9ffdf-2433-43da-a089-ebd0c80d8469 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:08:56.397669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e98667ae014396bd1b2e04533037be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc3f6aac547489fa25a163e016f8eef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.404878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-286e31aa-3a5a-4257-9a71-263588ac8b28 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 200 len: 1303 microversion: 2.1 time: 0.127530 Jun 18 08:08:56.405487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:56 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:56.775480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:56.776140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:56.783211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.783653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.784406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:56.784839 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:56.919641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.927737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.929228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:56.930506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0cab90b4-8b1b-4b27-95b4-a01d3f907f17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.161095 Jun 18 08:08:56.931108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 151/296] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:56 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:57.178969 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:57.179637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:57.186712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.187204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.187988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.188412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.313751 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:57.315401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:57.322007 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.322445 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.323216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.323633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.325235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:57.332965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-68da55c7-7aff-46bb-af81-1f8e6adcc167 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.158122 Jun 18 08:08:57.333554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 146/297] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:57 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:57.422018 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:57.422611 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] [instance: d6f9ffdf-2433-43da-a089-ebd0c80d8469] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:57.428845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.429385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.430117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.430592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.445453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] HTTP exception thrown: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Request method failure captured: Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 HTTP/1.1 Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfaZBsU6rnTOH2Q6_J4T6bgb5UUQvJXmct_ecxsDl5vKDBnjv1wnRhpjScXPboq2Ss19v51Texlg2pt0UHoLH9raD9Zs9ht8gnf0plDtWiNdVNjRvIz2gchHQ3SavBJoW2Ilma1UuSmuyW_KzT7PYE1l5XezIHLnA_EgdJew5xk9lg Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 7fc3f6aac547489fa25a163e016f8eef Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesActionsTest-599769028 Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:08:57.447199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fc3f6aac547489fa25a163e016f8eef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fc3f6aac547489fa25a163e016f8eef", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesActionsTest-599769028 Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7fc3f6aac547489fa25a163e016f8eef Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesActionsTest-599769028 Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesActionsTest-599769028-project Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: b2e98667ae014396bd1b2e04533037be Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesActionsTest-599769028-project Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. Jun 18 08:08:57.448690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'd6f9ffdf-2433-43da-a089-ebd0c80d8469'} Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:08:57.449482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. Jun 18 08:08:57.450813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:08:57.451894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] Returning 404 to user: Instance d6f9ffdf-2433-43da-a089-ebd0c80d8469 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:08:57.451894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eef1ff03-5ed8-49b4-ba59-39662a5c1bb1 tempest-VolumesActionsTest-599769028 tempest-VolumesActionsTest-599769028-project] 10.222.0.23 "GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469" status: 404 len: 111 microversion: 2.1 time: 0.030461 Jun 18 08:08:57.453883 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 147/298] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:57 2022] GET /compute/v2.1/servers/d6f9ffdf-2433-43da-a089-ebd0c80d8469 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:08:57.466435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:57.474479 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-356d772c-6418-49b8-91fb-2ba9479ada9e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.164625 Jun 18 08:08:57.475044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 152/299] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:57 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:08:57.950209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:57.950811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:57.958780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.958780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:57.958780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:57.959194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:58.100801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:58.109364 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:58.110873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:58.112041 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17815071-303c-43b5-9938-47ed9d5281db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.166198 Jun 18 08:08:58.112595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 148/300] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:57 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:58.350442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:58.351062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:58.358055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:58.358503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:58.359293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:58.359712 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:58.491839 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:58.492486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:58.494914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:58.499324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:58.499787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:58.500553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:58.500991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:58.503004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-88017641-a1a2-4480-9856-f8ad196e8df8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.156520 Jun 18 08:08:58.503592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 153/301] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:58 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:58.520196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:08:58.635204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:58.643609 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b5ee21a0-aa8c-4f6c-a14b-977af4544d1c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.155649 Jun 18 08:08:58.644361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 149/302] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:58 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:59.135671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:59.137151 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:59.148205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.149095 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.149915 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.150368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.286279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:59.294979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:59.296526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:59.297696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-533a43e3-ddb5-4ddd-9211-376ddb2d0bac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.168551 Jun 18 08:08:59.298234 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 154/303] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:08:59 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:08:59.520379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:59.520955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:59.528117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.528565 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.529303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.529753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.661270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:08:59.662196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:08:59.670224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:59.671405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.671835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.672608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:08:59.673032 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:08:59.678573 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17a71610-6246-4085-a07e-bdef72b0d6f4 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.162417 Jun 18 08:08:59.685534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 150/304] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:59 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:08:59.813186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:08:59.823055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f43f0e51-b253-4fe2-bc58-8010f8a48871 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.166061 Jun 18 08:08:59.823644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 155/305] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:08:59 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:00.321494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:00.322081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:00.330818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.331415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.332195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.332658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.472343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:00.480676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:00.482510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:00.483852 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-07195441-2d7b-4802-83a5-241df89ed377 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.166326 Jun 18 08:09:00.484520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 151/306] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:00 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:00.698229 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:00.698835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:00.706150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.706587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.707382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.707804 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.841231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:00.841825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:00.843375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:00.844177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:00.850127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.850580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.851167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c2b0fc0a-5347-4840-83ab-c9a01e2744f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.157002 Jun 18 08:09:00.851367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:00.851739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 156/307] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:00 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:00.851872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:00.996016 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:01.004446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4414ba7-bae7-4a7f-a53d-49a227e22612 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.167325 Jun 18 08:09:01.005009 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:00 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:01.501574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:01.502204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:01.508442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:01.508818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:01.509676 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:01.510101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:01.643077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:01.651520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:01.653000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:01.654200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-afadd1c4-6fc7-45ec-8edc-79c795bf16ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.156507 Jun 18 08:09:01.654763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 157/309] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:01 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:01.868584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:01.869213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:01.876275 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:01.876719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:01.877465 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:01.877887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:02.003788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:02.011473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb618e5b-68a5-4f75-b625-e97adc09e7e3 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.146745 Jun 18 08:09:02.012027 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 153/310] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:01 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:02.022138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:02.022815 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:02.030614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:02.031078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:02.031829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:02.032251 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:02.036335 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:02.165071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:02.173527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7675ab82-37e4-42dd-b712-b678881d957e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.155737 Jun 18 08:09:02.174114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 158/311] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:02 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:02.676446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:02.677052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:02.683415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:02.683858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:02.684646 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:02.685076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:02.818930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:02.827034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:02.828544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:02.829695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cb9d5ec7-400c-44c6-b657-e52c8ac8a728 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.157222 Jun 18 08:09:02.830256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 154/312] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:02 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:03.032511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:03.033362 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:03.043115 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.043557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.044312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.044731 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.174034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:03.185099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-065215ba-2966-465b-adc3-08562bbeb226 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.159091 Jun 18 08:09:03.185637 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 159/313] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:03 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:03.190873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:03.191530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:03.199380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.199831 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.200604 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.201037 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.341952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:03.354099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5c59f69b-7b00-43a3-a80e-c41ef5dbefdb tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.167120 Jun 18 08:09:03.354841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 155/314] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:03 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:03.852101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:03.853452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:03.859980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.860414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.861178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:03.861610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:03.992711 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:04.000799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:04.002299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:04.003519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5bcf123-1ab4-4173-9caa-38b719664ddd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.158105 Jun 18 08:09:04.004089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 160/315] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:03 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:04.205530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:04.206181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:04.215350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:04.215788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:04.216541 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:04.216965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:04.359220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:04.367116 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7d2646e7-3673-4135-8ead-2afa641995bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.167892 Jun 18 08:09:04.367658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:04 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:04.371910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:04.372479 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:04.379501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:04.379948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:04.380704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:04.381134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:04.515313 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:04.523684 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-decd67bd-9599-451c-b51a-e81587448152 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.155679 Jun 18 08:09:04.524243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 161/317] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:04 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:05.026952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:05.027601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:05.035121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.035651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.036543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.037057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.172783 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:05.180725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:05.182202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:05.183372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-275934e8-8f22-4c26-8b65-daab46e04b78 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.163176 Jun 18 08:09:05.183959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 157/318] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:05 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:05.384732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:05.385374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:05.392626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.393097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.393886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.394291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.534666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:05.541227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:05.542802 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6fa9c7bb-3f10-466a-a530-98a2b81239f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.162403 Jun 18 08:09:05.543360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:05.543480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 162/319] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:05 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:05.554591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.554843 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.555679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:05.556102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:05.741199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:05.749629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e6f7f967-f10e-4c9d-a322-71994d2f7fe5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.212333 Jun 18 08:09:05.750210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:05 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:06.203460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:06.203865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:06.210549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.210988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.211787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.212215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.346931 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:06.355176 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:06.356843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:06.358085 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6d97a888-7d64-47bc-bc68-8a20f87d8b66 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.158964 Jun 18 08:09:06.358856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 163/321] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:06 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:06.560769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:06.561491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:06.569109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.569560 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.570322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.570754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.722850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:06.730748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-85acccf2-2a10-4cd9-8b02-84ab737c4542 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.174439 Jun 18 08:09:06.731549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 159/322] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:06 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:06.771808 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:06.772435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:06.780235 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.780744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.781678 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:06.782097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:06.924054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:06.932937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-906e8560-4268-47ad-aee9-710535c56218 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.169512 Jun 18 08:09:06.933612 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 164/323] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:06 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:07.376726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:07.377655 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:07.384158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.384603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.385325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.386011 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.520680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:07.529325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:07.531105 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:07.532255 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-34a9daf1-a661-41e1-ab2f-27fdba4d3b6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.159530 Jun 18 08:09:07.532811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 160/324] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:07 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:07.747781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:07.749116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:07.755809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.756320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.757083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.757502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.950938 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:07.951822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:07.959216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:07.965595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.966044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.967990 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:07.968601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:07.970836 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bfd1303e-df78-40f1-af45-cbf559509bc8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.226710 Jun 18 08:09:07.971441 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 165/325] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:07 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:08.122812 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:08.131522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7f7515fd-f609-48e3-b43d-81846b676059 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.185053 Jun 18 08:09:08.139160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 161/326] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:07 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:09:08.557388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:08.559042 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:08.566984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:08.567819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:08.568648 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:08.569075 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:08.714901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:08.723793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:08.725281 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:08.727035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8aa57f2d-21f3-4aaa-a019-622234bb2a67 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.178938 Jun 18 08:09:08.728058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 166/327] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:08 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:08.990679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:08.991501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:08.999421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:08.999994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.000748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.001294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.144054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.148627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:09.149223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:09.152559 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-983a3605-6db6-4928-bd6d-f249f6e572e1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1500 microversion: 2.1 time: 0.168084 Jun 18 08:09:09.153433 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 162/328] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:08 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:09.156012 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.156645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.157581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.158249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.168926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d1d1dd8-96a3-4be6-a1fe-4347355117bb"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:09.170065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:09.176686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.177329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.178279 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.178705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.203644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] HTTP exception thrown: Cannot 'attach_volume' instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb while it is in vm_state rescued Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Request method failure captured: Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/os-volume_attachments HTTP/1.1 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 74 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYen-2sGjB4XSmK77OS9Uj6OBn3ySfH8juXZ-HV2P_kSMz_IN71w4LPGiZ17uk2sONdCnqZ8BNIszDzBmJyvg7sCBPtVifUTezq51ZvE524S0zFh40PZTubZYw1ykx_eqYWh_Hdr_msQ_KfGwxptBAdOJQKRHRoaMAupxnE4YmhB9DY Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:09:09.206076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bc66714da4345ddb2639465d29fcae0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 62c79651096b4ac3a7414e70c8bdcd7e Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {"volumeAttachment": {"volumeId": "8d1d1dd8-96a3-4be6-a1fe-4347355117bb"}} Jun 18 08:09:09.207617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Cannot 'attach_volume' instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb while it is in vm_state rescued Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '2f43c1dc-385b-4a5e-8e43-7f7a359df2fb', 'body': {'volumeAttachment': {'volumeId': '8d1d1dd8-96a3-4be6-a1fe-4347355117bb'}}} Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:09:09.208514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb while it is in vm_state rescued Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:09:09.209908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:09:09.211331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:09:09.211331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:09:09.211331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb while it is in vm_state rescued Jun 18 08:09:09.211331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:09:09.212368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Returning 409 to user: Cannot 'attach_volume' instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb while it is in vm_state rescued {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:09:09.213432 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-54c07bd6-6781-4af0-8dfc-edab5cc9e736 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048488 Jun 18 08:09:09.214511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 163/329] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:09:09 2022] POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 08:09:09.222794 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:09.223675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:09.230876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.231554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.232505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.233082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.307099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-235d7d39-0fc4-4cce-a99f-714539e792d6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/action" status: 202 len: 0 microversion: 2.1 time: 0.087866 Jun 18 08:09:09.308052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 164/330] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:09:09 2022] POST /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:09:09.318824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:09.319670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:09.322918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.328162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.328162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.328733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.328979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.338384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fab98e92-00c2-428a-8b6c-01519e625143 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.193305 Jun 18 08:09:09.339600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 167/331] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:09 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:09:09.355621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:09.612337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.620147 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-52564b3e-0dac-413a-b7d1-bc8b7de2cb97 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1508 microversion: 2.1 time: 0.307714 Jun 18 08:09:09.620822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 165/332] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:09 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:09:09.747212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:09.748323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:09.754775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.755327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.756102 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:09.756533 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:09.897525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.908811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.912482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:09.913005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-59978b4d-6f10-47a6-a262-c03611f2173c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.169624 Jun 18 08:09:09.926456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 168/333] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:09 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:10.355530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:10.356129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:10.362456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.362931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:10.364174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.364453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:10.499053 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:10.507279 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2ee169f6-e74a-4c42-bb33-890457311e6b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.155808 Jun 18 08:09:10.507882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 166/334] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:10 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:10.637318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:10.637891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:10.645866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.646343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:10.647334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.648108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:10.808232 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:10.816189 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9fa4a9a3-a2a8-4d80-9c4e-5e95b54a5cae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1508 microversion: 2.1 time: 0.182923 Jun 18 08:09:10.816768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 169/335] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:10 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:10.933402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:10.934010 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:10.941132 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.941607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:10.942521 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:10.942937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:11.128410 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:11.142115 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:11.143916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:11.145345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4c80bc71-632e-445f-a2e7-bc87a9f72bc1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.216059 Jun 18 08:09:11.155202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 167/336] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:10 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:11.524265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:11.524749 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:11.531246 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:11.531695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:11.532455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:11.533071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:11.667207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:11.675602 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-81a49c53-b10b-4073-8087-e5645e0cce40 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.155408 Jun 18 08:09:11.676154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 170/337] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:11 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:11.833995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:11.834759 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:11.844053 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:11.844539 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:11.845296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:11.845718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:11.980546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:11.988264 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bd9a82b1-8af6-4def-bb39-8738df0d0f60 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1508 microversion: 2.1 time: 0.158884 Jun 18 08:09:11.988845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 168/338] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:11 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:12.164222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:12.165129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:12.171500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:12.172159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:12.173333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:12.183174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:12.315696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:12.326830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:12.328896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:12.330474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2af58632-69f1-4395-afac-71f36cdbcd25 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.169869 Jun 18 08:09:12.331183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 171/339] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:12 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:12.709653 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:12.710293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:12.721569 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:12.729266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:12.730262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:12.731761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:12.921132 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:12.930211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-87bbc3c0-a959-4dbe-8703-4af228ae1af2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.239939 Jun 18 08:09:12.930814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 169/340] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:12 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:13.011122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:13.013423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:13.024414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.025170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:13.026537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.027393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:13.160027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:13.167969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-203dbe76-664f-420e-9ab7-a83e650be922 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1514 microversion: 2.1 time: 0.163095 Jun 18 08:09:13.168540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 172/341] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:13 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:13.351535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:13.352138 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:13.358625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.359115 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:13.359874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.360294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:13.507653 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:13.516815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:13.518722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:13.519901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-46335c12-f95e-4492-b428-d13a2b2f6d98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.174468 Jun 18 08:09:13.520450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 170/342] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:13 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:13.948712 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:13.949346 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:13.955983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.956436 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:13.957198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:13.957631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:14.084904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:14.094615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-44f73681-d230-443d-9b10-32076b400ea0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.149794 Jun 18 08:09:14.097737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 173/343] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:13 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:14.540615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:14.541264 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:14.544674 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6035e5d4-5a0c-4db3-898c-8d9d15102063 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: .version_select at 0x7f3bdf5d14c0>, body: {"keypair": {"name": "tempest-keypair-809745430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLUyUMTy55MXWf39FOVx5y/em5iK21zTamHMvEdaa3WO14ZoMS25C5Pq/ADoywA3b40g30zHRu/83llANz0otm3HZcBg27tPBZIHjHLODCk377FVuoaRKClHl9D0Kv7pQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:14.548928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:14.549628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:14.553171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:14.553678 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:14.554554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:14.569451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-6035e5d4-5a0c-4db3-898c-8d9d15102063 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for project 6bc66714da4345ddb2639465d29fcae0. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:09:14.573798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-6035e5d4-5a0c-4db3-898c-8d9d15102063 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for user 62c79651096b4ac3a7414e70c8bdcd7e and project 6bc66714da4345ddb2639465d29fcae0. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:09:14.614217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6035e5d4-5a0c-4db3-898c-8d9d15102063 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073956 Jun 18 08:09:14.614863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 174/344] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:09:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:14.726001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:14.734897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:14.736406 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:14.737574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13a44606-afdd-4a55-ac48-914558580b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.201208 Jun 18 08:09:14.738170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 171/345] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:14 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:15.113065 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:15.113958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:15.121144 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:15.122032 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:15.122908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:15.123473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:15.333240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:15.345580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:15.351455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d3b65a9b-15ff-43a1-88b1-196d12b2718a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1722 microversion: 2.1 time: 0.242931 Jun 18 08:09:15.352008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 175/346] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:15 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:15.758648 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:15.760522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:15.767113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:15.767873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:15.768819 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:15.769394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:15.930273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:15.944074 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:15.945861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:15.947229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cef2e553-3b0e-4ab7-85e7-a50659b5f4eb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.193476 Jun 18 08:09:15.948143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 172/347] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:15 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:16.146835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1577107737", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da69f43b-cedd-4ee1-8ba8-69d4e8c9ce3f"}], "security_groups": [{"name": "tempest-securitygroup--1035601001"}], "key_name": "tempest-keypair-809745430", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:16.281179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] validate_networks() for [('da69f43b-cedd-4ee1-8ba8-69d4e8c9ce3f', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:09:16.369329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:16.370459 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:16.384086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.385107 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.389152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.389558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.585674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:16.598804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c6a6a5c8-eca9-412d-8f45-46a974a083a0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1699 microversion: 2.1 time: 0.231097 Jun 18 08:09:16.601025 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 173/348] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:16 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1699 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:16.617384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b3f3339b-3ff3-478a-819c-82645bd69614 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:16.624481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3f3339b-3ff3-478a-819c-82645bd69614 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.625186 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3f3339b-3ff3-478a-819c-82645bd69614 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.699870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b3f3339b-3ff3-478a-819c-82645bd69614 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Going to try to start instance {{(pid=117616) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 08:09:16.770067 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b3f3339b-3ff3-478a-819c-82645bd69614 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.156459 Jun 18 08:09:16.771610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 174/349] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:09:16 2022] POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:09:16.782550 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:16.785620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:16.791958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:09:16.792547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:09:16.793870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:09:16.794742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:09:16.794998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.795610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.796510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.797286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.797399 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:09:16.835413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.836074 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.837428 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.839768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.876457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:09:16.883528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Getting quotas for user 62c79651096b4ac3a7414e70c8bdcd7e and project 6bc66714da4345ddb2639465d29fcae0. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:09:16.897679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:09:16.900550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:09:16.964576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5a00312a-514e-4865-ba68-b11832075316 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.822005 Jun 18 08:09:16.965946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 176/350] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:09:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:09:16.971944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:16.972905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:16.980900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.981787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:16.986271 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:16.986955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:17.184763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:17.197636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:17.201096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:17.207086 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ab23ce25-dfee-49ee-a449-4fa56a09c4e2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.237349 Jun 18 08:09:17.208957 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 177/351] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:16 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:17.214542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b1922e9e-b1ad-471a-a41b-b01b3cb2b43c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:17.215179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b1922e9e-b1ad-471a-a41b-b01b3cb2b43c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:17.371608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b1922e9e-b1ad-471a-a41b-b01b3cb2b43c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:17.381586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b1922e9e-b1ad-471a-a41b-b01b3cb2b43c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1245 microversion: 2.1 time: 0.169386 Jun 18 08:09:17.383340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 178/352] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:17 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:17.415409 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:17.426316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b6e0a1cf-16b8-4f5c-a00c-35baed049de5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1708 microversion: 2.1 time: 0.650290 Jun 18 08:09:17.426907 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 175/353] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:16 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1708 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:18.229056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:18.229787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:18.240574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.241021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.243688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.244518 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.403879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:18.405085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:18.412596 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.412957 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.414297 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.414899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.467590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:18.480035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:18.482017 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:18.483458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d13b312-6b7e-49f4-8084-d91469d45bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.258701 Jun 18 08:09:18.483593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:18.486742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 179/354] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:18 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:18.493551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:18.494497 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:18.503382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0be9c3e7-0b1c-4b63-a2f2-842191422b0f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1305 microversion: 2.1 time: 0.103271 Jun 18 08:09:18.504375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 176/355] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:18 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:09:18.508147 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.508654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.509499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:18.509993 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:18.680768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:18.691405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-60f9c105-7f0d-4e8b-9f90-614f586f2898 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1708 microversion: 2.1 time: 0.203083 Jun 18 08:09:18.706615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 180/356] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:18 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1708 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:19.527090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:19.528251 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:19.531848 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:19.532461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:19.549555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.552211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.555199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.557299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.557907 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.558565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.559731 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.563154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.741825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:19.754510 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9d9e282c-e2e4-4dbb-b239-dfc91fcb361c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1303 microversion: 2.1 time: 0.236290 Jun 18 08:09:19.756249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 181/357] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:19 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1303 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:19.761499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:19.762421 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:19.770103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.770863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.772008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:19.772664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:19.941254 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:19.959716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ec90b3d8-98f9-4c5b-8cb4-a3442daa7d06 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1712 microversion: 2.1 time: 0.202111 Jun 18 08:09:19.963450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 182/358] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:19 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1712 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:19.968523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a49b33f5-c410-470f-ba4a-68acd7ab8e9f", "device": "/dev/sdb"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:19.980691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:19.994142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:20.006730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:20.008195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:20.008844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:20.137001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:20.165711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:20.174157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:20.193019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-08681817-5ae1-4b05-ad87-6aa646cb4936 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.677636 Jun 18 08:09:20.194019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 177/359] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:19 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:20.679604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ea635e20-c4f5-4fce-963c-68f77cb41652 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "POST /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714689 Jun 18 08:09:20.699110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 183/360] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:09:19 2022] POST /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:20.772679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:20.773270 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:20.782097 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:20.791857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:20.793375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:20.794013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:21.121709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:21.131577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82c0cadd-00b0-483b-bb7d-be1056825e61 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.362686 Jun 18 08:09:21.142945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 178/361] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:20 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:21.212638 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:21.213383 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:21.224877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:21.225333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:21.226139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:21.226635 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:21.513301 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:21.524405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:21.525997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:21.527454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4447092e-6a21-4160-9600-63f02d1bd56a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1742 microversion: 2.20 time: 0.319705 Jun 18 08:09:21.553480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 184/362] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:21 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1742 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:21.611055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-4811a4e4-09f4-4307-9750-6649923f6049 req-33fe12ce-85fb-4d54-b453-2133f2c4bf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:21.627240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4811a4e4-09f4-4307-9750-6649923f6049 req-33fe12ce-85fb-4d54-b453-2133f2c4bf51 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:21.631697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4811a4e4-09f4-4307-9750-6649923f6049 req-33fe12ce-85fb-4d54-b453-2133f2c4bf51 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:21.658351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-4811a4e4-09f4-4307-9750-6649923f6049 req-33fe12ce-85fb-4d54-b453-2133f2c4bf51 service nova] Creating event network-changed:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:09:21.672895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-4811a4e4-09f4-4307-9750-6649923f6049 req-33fe12ce-85fb-4d54-b453-2133f2c4bf51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066590 Jun 18 08:09:21.674134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 179/363] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:22.153113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:22.154349 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:22.169628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:22.170303 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:22.173407 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:22.175585 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:22.340261 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0adbf2a4-37f1-46d4-882e-f95dcefeaada req-4b48afda-074f-4c43-89c2-9c5f8f805f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "name": "network-vif-plugged", "status": "completed", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:22.366203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0adbf2a4-37f1-46d4-882e-f95dcefeaada req-4b48afda-074f-4c43-89c2-9c5f8f805f15 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:22.367673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0adbf2a4-37f1-46d4-882e-f95dcefeaada req-4b48afda-074f-4c43-89c2-9c5f8f805f15 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:22.394815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0adbf2a4-37f1-46d4-882e-f95dcefeaada req-4b48afda-074f-4c43-89c2-9c5f8f805f15 service nova] Creating event network-vif-plugged:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:09:22.402553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0adbf2a4-37f1-46d4-882e-f95dcefeaada req-4b48afda-074f-4c43-89c2-9c5f8f805f15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069753 Jun 18 08:09:22.403822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 180/364] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:22.482027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:22.490650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fc179b3a-0719-4a80-9cbc-e1d1534266df tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.342698 Jun 18 08:09:22.491285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 185/365] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:22 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:22.551615 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:22.552605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:22.560311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:22.560845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:22.561902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:22.562404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:22.693944 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:22.706703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:22.709258 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:22.711086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a9972859-5720-4d29-a54a-9353b065c8c2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1742 microversion: 2.20 time: 0.163922 Jun 18 08:09:22.711987 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 181/366] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:22 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:23.507003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:23.507939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:23.519135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:23.519135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:23.519135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:23.520374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:23.694718 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:23.703044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b77259a1-77bb-4d23-b169-dabfb8fee163 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.199869 Jun 18 08:09:23.712443 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 186/367] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:23 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:23.735631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:23.737663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:23.745283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:23.745979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:23.747209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:23.748184 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:23.786571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:24.003891 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:24.018850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:24.021583 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:24.022800 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f1dcf162-d1de-41a0-9235-854e043c8619 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1742 microversion: 2.20 time: 0.297949 Jun 18 08:09:24.028707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 182/368] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:23 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1742 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:24.719868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:24.720499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:24.727540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:24.728206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:24.729138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:24.729567 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:24.888914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:24.903910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e13c788a-797b-409c-9c11-29761eca9707 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.187811 Jun 18 08:09:24.904500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 187/369] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:24 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:25.050949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:25.051624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:25.067620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:25.069226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:25.071958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:25.072683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:25.291260 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:25.303373 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:25.306061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:25.308024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd6e81df-e2f9-49e1-8572-116a3997e6f6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.263937 Jun 18 08:09:25.309212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 183/370] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:25 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:09:25.921025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:25.922363 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:25.929513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:25.929937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:25.930907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:25.931525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:26.356879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:26.365251 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:26.395574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:26.402732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:26.403118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:26.406064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:26.407865 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:26.411234 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3566a661-9437-4ac5-85ec-333cce7458f5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.494184 Jun 18 08:09:26.413145 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 188/371] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:25 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:26.777834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-69457e16-2f42-4898-931b-2e6ff3bf75e9 req-2439bb3d-91ac-4301-bc7d-3325ec945ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "name": "network-vif-plugged", "status": "completed", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:26.798436 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-69457e16-2f42-4898-931b-2e6ff3bf75e9 req-2439bb3d-91ac-4301-bc7d-3325ec945ff2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:26.799501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-69457e16-2f42-4898-931b-2e6ff3bf75e9 req-2439bb3d-91ac-4301-bc7d-3325ec945ff2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:26.836285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-69457e16-2f42-4898-931b-2e6ff3bf75e9 req-2439bb3d-91ac-4301-bc7d-3325ec945ff2 service nova] Creating event network-vif-plugged:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:09:26.849170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-69457e16-2f42-4898-931b-2e6ff3bf75e9 req-2439bb3d-91ac-4301-bc7d-3325ec945ff2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074212 Jun 18 08:09:26.851476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 189/372] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:26.964012 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:26.980040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:26.986724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:26.989876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c176ee2-4d44-4d4e-8f83-fe01efe4dc24 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.660540 Jun 18 08:09:26.992524 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 184/373] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:26 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:09:27.430519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:27.431318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:27.456677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:27.458296 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=12 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:27.460087 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:27.460508 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:27.461279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:27.461704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:27.795666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:27.804342 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6fa9ca27-0035-4cff-8aa7-ea983b0b0e04 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.377958 Jun 18 08:09:27.815513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 190/374] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:27 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:28.031261 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:28.032744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:28.060683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:28.061425 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:28.062447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:28.063045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:28.343415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:28.357864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:28.364408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:28.366209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-41d6ed05-1bac-466f-8f51-78bd26883c03 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.344532 Jun 18 08:09:28.366889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 185/375] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:28 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:28.826624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:28.827355 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:28.842549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:28.844058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:28.846299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:28.847665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:29.096112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:29.110589 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ac514821-a1c5-45a5-8208-60f761e06830 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.289931 Jun 18 08:09:29.111818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 191/376] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:28 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:29.418373 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:29.420003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:29.428585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:29.429222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:29.430281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:29.430969 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:29.629301 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:29.639239 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:29.642267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:29.643656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-40a00593-95c4-489b-921a-d11ef9da300a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.244725 Jun 18 08:09:29.644875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 186/377] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:29 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:09:30.128782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:30.129401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:30.143093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:30.143793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:30.144748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:30.145341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:30.329467 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:30.338459 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3bd58b3e-4c3d-4e80-a810-cd47799f51bd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.213513 Jun 18 08:09:30.340068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 192/378] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:30 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:30.666720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:30.669321 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:30.691931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:30.693163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:30.694498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:30.695335 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:30.967855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:30.981574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:30.984265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:30.991580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-11f6d49a-eb07-4e7b-adc7-a7fdd87ee5bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.328433 Jun 18 08:09:30.993916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 187/379] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:30 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:31.356400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:31.357002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:31.363621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:31.364480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:31.365253 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:31.365834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:31.388453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:31.517790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:31.525531 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae987680-5d9f-407d-a81a-0f10d45442f0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.173207 Jun 18 08:09:31.526116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 193/380] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:31 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:32.011626 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:32.012230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:32.017025 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=72 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:32.022295 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:32.022730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:32.023493 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:32.024192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:32.162452 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:32.170716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:32.172223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:32.173628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b9274d63-e026-4e17-b8e0-312586afa4e4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.166024 Jun 18 08:09:32.174523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 188/381] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:32 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:32.542216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:32.544163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:32.554548 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:32.555005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:32.555819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:32.556248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:32.800625 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:32.848519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf2bd28a-60d7-4d77-8dd6-4bde8a616132 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.310220 Jun 18 08:09:32.859838 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 194/382] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:32 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:33.194143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:33.194811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:33.204843 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:33.205413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:33.206382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:33.206807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:33.410546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:33.419363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:33.421104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:33.422270 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-36fd2904-a515-4414-8a36-2b83d4707298 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.233827 Jun 18 08:09:33.423394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 189/383] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:33 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:33.877696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:33.878688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:33.903434 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:33.903434 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:33.903434 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:33.903838 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:34.231152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:34.250211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c52b161e-98ae-4f06-8e45-390d4cab342c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1371 microversion: 2.1 time: 0.376721 Jun 18 08:09:34.258696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 195/384] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:33 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:34.442432 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:34.443827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:34.455610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:34.456616 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:34.457478 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:34.457980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:34.613208 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:34.627361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:34.629199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:34.630367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f122b0f-f37f-4146-b3e4-7e14508564ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.192455 Jun 18 08:09:34.630958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 190/385] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:34 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:35.283058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:35.283727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:35.294092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.294982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.296112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.296828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.462573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:35.471167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3c1b500b-3cfe-44d5-b5ea-c1742847258d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1564 microversion: 2.1 time: 0.196921 Jun 18 08:09:35.471881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 196/386] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:35 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:35.487340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:35.488497 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:35.495489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.496163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.496927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.497351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.593581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ef229b10-5dbb-49a4-bcc6-6cd878e812b1 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110013 Jun 18 08:09:35.595391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 191/387] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:09:35 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:35.648528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:35.649143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:35.661363 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.661845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.662650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:35.663107 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:35.908265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:35.920357 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:35.921863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:35.923125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-722a580c-64c8-45a0-9787-a93a406f81e3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.278461 Jun 18 08:09:35.926231 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 197/388] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:35 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:36.725929 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-714a68ce-f1a6-43f7-bd3f-3e369c5c6a48 req-0e17c4f2-459b-4a04-a852-138a99410960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:36.735666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-714a68ce-f1a6-43f7-bd3f-3e369c5c6a48 req-0e17c4f2-459b-4a04-a852-138a99410960 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:36.736111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-714a68ce-f1a6-43f7-bd3f-3e369c5c6a48 req-0e17c4f2-459b-4a04-a852-138a99410960 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:36.748532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-714a68ce-f1a6-43f7-bd3f-3e369c5c6a48 req-0e17c4f2-459b-4a04-a852-138a99410960 service nova] Creating event network-changed:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:09:36.754639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-714a68ce-f1a6-43f7-bd3f-3e369c5c6a48 req-0e17c4f2-459b-4a04-a852-138a99410960 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032775 Jun 18 08:09:36.755561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 192/389] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:36.958750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:36.959340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:36.966804 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:36.967350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:36.968179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:36.968669 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:37.099830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:37.108087 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:37.109607 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:37.110766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0791e9fb-2b38-4074-ae09-89aeb14f94cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1737 microversion: 2.20 time: 0.156269 Jun 18 08:09:37.111362 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 198/390] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:36 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:38.129698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:38.130386 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:38.136945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:38.137383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:38.138142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:38.138565 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:38.329523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:38.337975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:38.339491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:38.340668 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-453b8e11-4a59-41e8-80f5-f6c7cf1a8d19 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1719 microversion: 2.20 time: 0.215774 Jun 18 08:09:38.341242 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 193/391] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:38 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:39.363457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:39.364452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:39.375588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:39.376296 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:39.377054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:39.377483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:39.525040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:39.533331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:39.534855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:39.536041 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9efe6464-3b30-462d-b067-67c08e211861 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1719 microversion: 2.20 time: 0.179178 Jun 18 08:09:39.536610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 199/392] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:39 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:09:40.554384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:40.554990 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:40.561548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:40.562007 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:40.562865 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:40.563736 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:40.703095 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:40.715137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:40.717442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:40.719328 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-92ba0bb2-e8e8-416a-b0ed-1ba8068e11af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1719 microversion: 2.20 time: 0.168697 Jun 18 08:09:40.720187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 194/393] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:40 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:41.369448 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-74319027-6b73-47b9-aabb-274ba45c4bea req-319651da-c42c-41a7-ad68-2bc6d8e14443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:41.381496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-74319027-6b73-47b9-aabb-274ba45c4bea req-319651da-c42c-41a7-ad68-2bc6d8e14443 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:41.382124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-74319027-6b73-47b9-aabb-274ba45c4bea req-319651da-c42c-41a7-ad68-2bc6d8e14443 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:41.395925 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-74319027-6b73-47b9-aabb-274ba45c4bea req-319651da-c42c-41a7-ad68-2bc6d8e14443 service nova] Creating event network-vif-unplugged:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:09:41.401292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-74319027-6b73-47b9-aabb-274ba45c4bea req-319651da-c42c-41a7-ad68-2bc6d8e14443 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035437 Jun 18 08:09:41.402764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 200/394] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:41.738047 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:41.738666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:41.745281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:41.745720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:41.746464 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:41.746890 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:41.876769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:41.884962 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:41.886442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:41.887604 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-56551865-b508-40d4-bc06-b9ddb200cfa0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1719 microversion: 2.20 time: 0.153616 Jun 18 08:09:41.888173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 195/395] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:41 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:42.906261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:42.907718 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:42.915033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:42.915486 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:42.916254 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:42.916678 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:43.065811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:43.075197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:43.077045 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:43.078255 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a64e4c7b-b318-43d7-bb31-aa43b34a75a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1719 microversion: 2.20 time: 0.176291 Jun 18 08:09:43.079312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 201/396] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:42 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:44.097481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:44.098208 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:44.105179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.105726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.106491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.106923 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.238140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:44.247342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:44.248986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:44.250177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d1283274-3773-43f8-ad3a-ed0030cc2763 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1722 microversion: 2.20 time: 0.156719 Jun 18 08:09:44.250638 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 196/397] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:44 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:44.273230 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "457f4d49-b04e-41f2-83e5-eea8fc1d80da"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:44.274344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:44.281215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.281671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.282432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.282857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.617194 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9132eacd-85d3-470d-8e28-dde1a34aa0ac tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350271 Jun 18 08:09:44.617973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 202/398] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Jun 18 08:09:44 2022] POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments => generated 188 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:09:44.739426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:44.739984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:44.746201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.746643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.747556 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.747984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.850819 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a215b4bc-81b0-4785-9d61-46c04c566228 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/action" status: 202 len: 0 microversion: 2.20 time: 0.115380 Jun 18 08:09:44.854707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 197/399] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 08:09:44 2022] POST /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:09:44.859784 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:44.860387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:44.862334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:44.868647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.869028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:44.869821 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:44.870302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:45.010543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:45.022325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:45.024001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:45.025404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-959df8e2-f3da-4910-b421-68095371467d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1748 microversion: 2.20 time: 0.169632 Jun 18 08:09:45.026265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 203/400] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:44 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:09:45.435487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:45.435970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:45.444271 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:45.445354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:45.446988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:45.447459 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:45.577625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'services' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:45.614366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:45.712702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-391f6f53-0d82-4d4e-8ef5-362e6a822b39 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382/os-volume_attachments/a49b33f5-c410-470f-ba4a-68acd7ab8e9f" status: 202 len: 0 microversion: 2.1 time: 0.281374 Jun 18 08:09:45.713293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 198/401] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:09:45 2022] DELETE /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382/os-volume_attachments/a49b33f5-c410-470f-ba4a-68acd7ab8e9f => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:09:46.047719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:46.048614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:46.059766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:46.060505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:46.061748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:46.062460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:46.236192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:46.245252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:46.246715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:46.247917 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-36a1221e-e543-472c-81bb-3a6fef906b7d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1748 microversion: 2.20 time: 0.206820 Jun 18 08:09:46.248497 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 204/402] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:46 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1748 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:47.270240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:47.270880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:47.278710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:47.279187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:47.279959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:47.280362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:47.415627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:47.424322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:47.425823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:47.427004 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-df55b312-7884-49da-a84f-243ff8565bcf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1750 microversion: 2.20 time: 0.163132 Jun 18 08:09:47.427586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 199/403] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:47 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:47.926521 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:47.927639 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:47.934435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:47.935189 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:47.935991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:47.936399 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:47.962506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:09:48.044186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-89e146c5-1449-46ab-ae44-cd7f57fb103f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 204 len: 0 microversion: 2.1 time: 0.121430 Jun 18 08:09:48.044789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 205/404] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:09:47 2022] DELETE /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:09:48.053214 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:48.053810 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:48.059980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:48.060415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:48.061165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:48.061589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:48.195120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:48.202996 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f2a33692-d0e2-42a3-b0bc-3a64ce632e91 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1514 microversion: 2.1 time: 0.153687 Jun 18 08:09:48.203636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 200/405] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:48 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:48.451817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:48.452803 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:48.461083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:48.461527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:48.462283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:48.462711 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:48.480842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:09:48.598934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:48.609540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:48.611883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:48.613535 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4c75dc58-d684-4fa1-92d3-0d1116689a4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.168814 Jun 18 08:09:48.614206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 206/406] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:48 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:49.220725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:49.221359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:49.228668 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:49.229103 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:49.229882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:49.230272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:49.375691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:49.383873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-520059b9-fdb8-4942-abce-13633ef86efa tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1514 microversion: 2.1 time: 0.167180 Jun 18 08:09:49.384434 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 201/407] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:49 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:49.636003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:49.636844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:49.644237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:49.644723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:49.645525 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:49.645984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:49.778128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:49.787528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:49.789032 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:49.790190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1100ad42-dede-49a5-bc24-7bdb5ef1b6ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.158472 Jun 18 08:09:49.790717 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 207/408] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:49 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:50.402975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:50.404395 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:50.413177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:50.413621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:50.414392 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:50.414813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:50.655748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:50.663852 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96252a47-698a-4e60-9fa5-b4b959835509 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1514 microversion: 2.1 time: 0.265900 Jun 18 08:09:50.664439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 202/409] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:50 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:50.808662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:50.809238 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:50.816884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:50.818076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:50.819270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:50.819701 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:50.963557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:50.972544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:50.974555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:50.975913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-12474821-0ad6-4f2b-b7f3-b76a1270fc98 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.171267 Jun 18 08:09:50.976762 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 208/410] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:50 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:51.379080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-7a6b414b-3e3c-47be-9b9e-ac54918dcfd9 req-4ab4e538-e7ba-445e-b7af-b6a9ca0fa97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78bbd92-5f1f-46c5-aab5-856f06c90382", "name": "network-vif-deleted", "tag": "b9ad9cab-6619-4942-a04b-ca380f88f089"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:09:51.388589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7a6b414b-3e3c-47be-9b9e-ac54918dcfd9 req-4ab4e538-e7ba-445e-b7af-b6a9ca0fa97f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:51.389064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7a6b414b-3e3c-47be-9b9e-ac54918dcfd9 req-4ab4e538-e7ba-445e-b7af-b6a9ca0fa97f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:51.403603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-7a6b414b-3e3c-47be-9b9e-ac54918dcfd9 req-4ab4e538-e7ba-445e-b7af-b6a9ca0fa97f service nova] Creating event network-vif-deleted:b9ad9cab-6619-4942-a04b-ca380f88f089 for instance f78bbd92-5f1f-46c5-aab5-856f06c90382 on hv-cinder-82634 Jun 18 08:09:51.408598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-7a6b414b-3e3c-47be-9b9e-ac54918dcfd9 req-4ab4e538-e7ba-445e-b7af-b6a9ca0fa97f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034551 Jun 18 08:09:51.409206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 203/411] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:09:51.681603 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:51.682205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:51.689013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:51.689453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:51.690346 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:51.691107 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:51.723742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:51.724368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:51.724814 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:51.767317 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:51.775106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5cda47c8-7e1f-4661-a7d6-44edf27ffe03 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.097538 Jun 18 08:09:51.776114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 209/412] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:51 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:52.006599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:52.007897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:52.015854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:52.016250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:52.017077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:52.017440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:52.218440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:52.229855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:52.231767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:52.233187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48eb3fb4-7025-4132-bf05-fdca65def854 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.232210 Jun 18 08:09:52.234388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 204/413] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:51 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:52.793945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:52.794822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:52.802621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:52.803048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:52.804116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:52.804750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:52.843534 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:52.844007 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:52.844511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:52.889761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:52.898648 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-848572b0-3cd1-4a34-990d-0fb15ae82eba tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.109108 Jun 18 08:09:52.899416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 210/414] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:52 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:53.252027 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:53.252670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:53.259888 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:53.260331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:53.261080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:53.261505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:53.406876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:53.416770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:53.418256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:53.419514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b51d2b2a-0b8b-4c75-b27d-b8b26484cd2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.171529 Jun 18 08:09:53.420070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 205/415] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:53 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:53.915937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:53.916547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:53.923675 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:53.923675 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:53.924351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:53.924774 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:53.964901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:53.965443 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:53.965889 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:54.010933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:54.018375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3b22f2eb-13e9-4220-8867-5ba34d35fcb0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.106401 Jun 18 08:09:54.018970 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 211/416] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:53 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:54.440709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:54.442400 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:54.451232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:54.451910 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:54.452769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:54.453565 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:54.600782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:54.609606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:54.611132 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:54.612300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-933dceab-eff6-4c8d-ab53-d22622ff79e9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.176713 Jun 18 08:09:54.612865 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 206/417] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:54 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:55.036121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:55.037526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:55.044687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:55.045240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:55.046111 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:55.046599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:55.076821 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:55.077185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:55.077625 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:55.117390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:55.124942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6bc8b658-a8fc-4438-9f93-55c2ed1bedbe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.092871 Jun 18 08:09:55.125502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 212/418] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:55 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:55.631125 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:55.633586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:55.642317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:55.643607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:55.644777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:55.645490 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:55.792556 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:55.801451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:55.802875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:55.804057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5e905573-54de-43f9-96d7-02a4b56c5221 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.177856 Jun 18 08:09:55.804677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 207/419] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:55 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:56.142016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:56.142649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:56.149276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:56.149716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:56.150468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:56.150893 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:56.181343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:56.181781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:56.182243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:56.235041 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:56.242984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7fbc23c8-7655-4d2e-8fff-3ed23dc3150e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.104847 Jun 18 08:09:56.243782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 213/420] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:56 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:56.829109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:56.830137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:56.839445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:56.839897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:56.840688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:56.841122 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:56.987219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:56.996365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:56.997847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:56.999799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-22c40e82-ef68-41b6-a19c-f200f58ecca8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.177783 Jun 18 08:09:57.004924 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 208/421] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:56 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:57.260719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:57.261445 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:57.268434 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:57.268910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:57.269703 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:57.270130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:57.301861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:57.302332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:57.302777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:57.351169 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:57.360414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-43e1226c-079e-406d-bcba-285885e45e16 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.104193 Jun 18 08:09:57.361417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 214/422] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:57 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:58.018708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:58.019341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:58.025955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:58.026401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:58.027192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:58.027624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:58.170682 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:58.182174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:58.184276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:58.186140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3e8ef6db-579a-4e75-8298-69481af5b23a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.171435 Jun 18 08:09:58.187897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 209/423] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:58 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:58.377979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:58.379459 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:58.387458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:58.388057 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:58.388952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:58.389866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:58.422274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:58.422699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:58.423183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:58.468048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:58.477801 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-debea876-a671-48c4-855d-3be5ef1f4e7d tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.104066 Jun 18 08:09:58.479208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 215/424] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:58 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:09:59.205552 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:59.206309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:59.212601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:59.213037 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:59.213803 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:59.214233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:59.348371 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:59.357915 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:59.359478 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:59.360905 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0765e4c8-e953-47a5-92a8-0d518909191f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.159535 Jun 18 08:09:59.372314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 210/425] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:09:59 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:09:59.497941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:09:59.498538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:09:59.507122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:59.507619 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:59.508782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:59.509205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:59.539397 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:09:59.539834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:09:59.540274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:09:59.588029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:09:59.597266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eee3652e-3457-4040-8e31-89a1274659db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.105170 Jun 18 08:09:59.597806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 216/426] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:09:59 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:00.383972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:00.384998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:00.397173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:00.397960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:00.400243 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:00.400927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:00.539688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:00.548074 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:00.549557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:00.550702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6e0d905a-f289-4216-99c0-a356c5ab7046 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.173598 Jun 18 08:10:00.551286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 211/427] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:00 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:00.614274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:00.614895 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:00.622129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:00.622581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:00.623389 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:00.623820 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:00.658576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:00.659028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:00.659485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:00.703040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:00.710588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-64db4d99-1244-4bad-8018-21d97838c2f0 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.100484 Jun 18 08:10:00.711369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 217/428] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:00 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:01.570568 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:01.571160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:01.571621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:01.572223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:01.578031 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.578477 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.578628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.578914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.579285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.579697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.579854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.580096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.604190 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-562c9b93-50d5-442f-b169-d0f5eafc1d25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.039456 Jun 18 08:10:01.610598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 212/429] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:10:01 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:01.724569 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:01.756096 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:01.765475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:01.767954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.772331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.772331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.772331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.780578 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:01.782324 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:01.782324 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2ab04ff-1e66-4b6a-8e78-65e45fbf71a6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.216305 Jun 18 08:10:01.787199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 218/430] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:01 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:01.828698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:01.829129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:01.829580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:01.884488 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:01.892864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2cc33270-ace6-441e-ac97-93f7fb19112e tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.163766 Jun 18 08:10:01.893796 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 213/431] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:01 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:10:02.807618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:02.808219 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:02.815617 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:02.816059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:02.817095 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:02.817520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:02.909629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:02.910343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:02.912954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=56 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:02.918580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:02.919123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:02.919943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:02.920434 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:02.951943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:02.952380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:02.952826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:02.953136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:02.974426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:02.976405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:02.980550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-08c5cf51-ea11-49a1-b457-f398c5046b69 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.176871 Jun 18 08:10:02.981148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 219/432] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:02 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:03.004633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:03.012117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-70664ed8-ef41-4763-ab12-bc62f1025c96 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.106338 Jun 18 08:10:03.012686 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 214/433] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:02 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:03.047866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dac6f8a-fcaf-43b0-a11d-0e6f371c7678"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:03.049003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:03.055698 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:03.056239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:03.057457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:03.057736 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:03.062959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:03.997755 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:03.998382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:04.005245 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:04.005695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:04.006452 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:04.006881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:04.026001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:04.141793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:04.150463 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:04.151980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:04.153128 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c1beb946-dad1-4cdf-ba49-bc8802c3663d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.159274 Jun 18 08:10:04.153677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 215/434] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:03 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:04.158395 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:04.158980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:04.164689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:04.165150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:04.165878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:04.166297 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:04.196324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:04.196758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:04.197194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:04.245859 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:04.259548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cdbbb976-786c-4d83-9720-fbbf18dfcdbd tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.104620 Jun 18 08:10:04.260390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 216/435] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:04 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:05.175417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:05.176461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:05.186541 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:05.186981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:05.188216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:05.188676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:05.323535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:05.336088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:05.338272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:05.339864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b85b8bb3-18f0-4024-ae9f-517a20ed8ce2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.170764 Jun 18 08:10:05.340659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 217/436] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:05 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:05.344958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:05.345549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:05.351467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:05.351941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:05.352691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:05.353117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:05.383522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:05.383960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:05.384406 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:05.427903 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:05.436120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50393f34-91d1-44c7-b010-eb75477c5765 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.094510 Jun 18 08:10:05.436701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 218/437] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:05 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:06.360009 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:06.360693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:06.367870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:06.368313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:06.369062 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:06.369483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:06.508487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:06.517557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:06.519042 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:06.520220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-871aed98-6dc2-4d13-ad3f-7aab80256913 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.164330 Jun 18 08:10:06.520751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 219/438] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:06 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:06.525230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:06.525814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:06.531498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:06.531939 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:06.532689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:06.533114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:06.564028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:06.564457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:06.564901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid f78bbd92-5f1f-46c5-aab5-856f06c90382 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:06.607475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:06.615447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-52e313ca-f4ce-47c5-b6cd-29c6db80a4d3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 200 len: 1309 microversion: 2.1 time: 0.093706 Jun 18 08:10:06.616030 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 220/439] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:06 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:07.362276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d31e9fe-fcd7-42d0-a490-30b85b0e4618 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.318453 Jun 18 08:10:07.363338 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 220/440] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:10:03 2022] POST /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments => generated 194 bytes in 4320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:07.539305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:07.540177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:07.547188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:07.547630 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:07.548358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:07.549005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:07.633378 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:07.634070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: f78bbd92-5f1f-46c5-aab5-856f06c90382] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:07.641417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:07.641752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:07.642523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:07.642953 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:07.656856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] HTTP exception thrown: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Request method failure captured: Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 HTTP/1.1 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYf867jcmFp36QPQMsAs5IGgL7kzImf5yz_PFN3y0VdWIqYqTqMNBi-ehdKmDzchjZx0JSMnIGSxl29__1mehKmtbvw6IB5TjjwYta0tX5VkwIYbWPAMhzdnBxExH0s9Y_uNK2sRqLBAuCZbzusppReSumMpemEteLMgIvqGJmmSKuE Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c53dba3c495141569fc1a011b51023b2 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:10:07.658660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c53dba3c495141569fc1a011b51023b2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c53dba3c495141569fc1a011b51023b2 Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotTestJSON-2020409798-project Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: c918c712ffb945f3b21bd76de9f22115 Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotTestJSON-2020409798-project Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. Jun 18 08:10:07.660258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'f78bbd92-5f1f-46c5-aab5-856f06c90382'} Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:10:07.661135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. Jun 18 08:10:07.662471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:10:07.664174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Returning 404 to user: Instance f78bbd92-5f1f-46c5-aab5-856f06c90382 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:10:07.664174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a8d013c-0f45-4946-b4b1-7bed3a697af6 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382" status: 404 len: 111 microversion: 2.1 time: 0.031296 Jun 18 08:10:07.664174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 221/441] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:07 2022] GET /compute/v2.1/servers/f78bbd92-5f1f-46c5-aab5-856f06c90382 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:10:07.764528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:07.774772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:07.776675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:07.778080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6ae7f20f-d499-4c08-91b9-edc2a2dd4d35 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.243527 Jun 18 08:10:07.778807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 221/442] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:07 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:08.797407 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:08.798008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:08.804655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:08.805101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:08.805855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:08.806285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:08.946818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:08.955872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:08.957358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:08.958530 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-929823e2-2e57-47d2-a87a-bc381d223e0b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.165573 Jun 18 08:10:08.959456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 222/443] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:08 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:09.980171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:09.981115 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:09.987772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:09.988224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:09.988985 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:09.989414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:10.120651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:10.130918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:10.132623 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:10.134722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ce6a1a62-22ae-42b7-9109-dd8eed0b3766 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.160841 Jun 18 08:10:10.135652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 222/444] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:09 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:11.158056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:11.158996 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:11.170159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:11.170599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:11.171387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:11.171819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:11.314312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:11.322967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:11.324570 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:11.325761 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-96db8e7e-bf77-4f26-9398-6b78d7631915 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.174654 Jun 18 08:10:11.326420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 223/445] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:11 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:12.343685 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:12.344967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:12.351752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:12.352191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:12.352956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:12.353406 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:12.490445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:12.498993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:12.500502 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:12.501657 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5c6e88ea-ce7e-4098-9fff-4619331dd092 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.162045 Jun 18 08:10:12.502221 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 223/446] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:12 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:13.519742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:13.520413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:13.527326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:13.527852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:13.528756 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:13.529261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:13.668127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:13.681200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:13.683601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:13.685283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d0cb94ef-ebde-4fca-aa8a-2a6062350c26 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.169838 Jun 18 08:10:13.686059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 224/447] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:13 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:14.705394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:14.706606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:14.713537 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:14.713973 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:14.714752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:14.715213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:14.859384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:14.868654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:14.870146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:14.871347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d43f5303-bc76-4fee-9d11-556e859b957f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.170691 Jun 18 08:10:14.871920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 224/448] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:14 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:10:15.890008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:15.890763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:15.893556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:15.899882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:15.900183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:15.901016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:15.901527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:16.051967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:16.061240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:16.063201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:16.064359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0bd0e17d-8c45-4eab-a0df-02b38a730de3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.178784 Jun 18 08:10:16.064961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 225/449] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:15 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:17.086142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:17.087251 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:17.098608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:17.099280 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:17.100525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:17.101233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:17.234424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:17.243390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:17.244885 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:17.246047 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b4b41722-bc03-4588-8348-f1a413fa7d92 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.166504 Jun 18 08:10:17.246578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 225/450] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:17 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:18.268400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:18.269241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:18.280422 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:18.281170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:18.282304 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:18.282738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:18.416089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:18.425097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:18.426580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:18.427775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7776db02-58ce-4319-909a-9de065dceac2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.166090 Jun 18 08:10:18.428347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 226/451] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:18 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:18.636408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1342932400", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "networks": [{"uuid": "34728dbd-466c-4060-9c86-3143df93aca9"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:18.692510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] validate_networks() for [('34728dbd-466c-4060-9c86-3143df93aca9', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:10:19.053298 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:10:19.053710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:10:19.054169 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:10:19.054571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:10:19.054992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:10:19.064930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:19.065369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:19.066148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:19.066572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:19.084592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Getting quotas for project c53dba3c495141569fc1a011b51023b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:10:19.092146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Getting quotas for user c918c712ffb945f3b21bd76de9f22115 and project c53dba3c495141569fc1a011b51023b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:10:19.104784 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:10:19.107170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:10:19.155162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8ef00c56-6fd8-4ae9-88e9-28a9b8a9bea3 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525176 Jun 18 08:10:19.155801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 226/452] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:10:19.165723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5a7820fa-b903-4df6-8b4c-e293f9ac74ab tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:19.166323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5a7820fa-b903-4df6-8b4c-e293f9ac74ab tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:19.216840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a7820fa-b903-4df6-8b4c-e293f9ac74ab tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:19.224082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5a7820fa-b903-4df6-8b4c-e293f9ac74ab tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1219 microversion: 2.1 time: 0.062204 Jun 18 08:10:19.224812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 227/453] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:19 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:19.446374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:19.447054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:19.454015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:19.454461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:19.455244 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:19.455670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:19.589962 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:19.602410 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:19.604832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:19.606562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c2a9b860-bfad-4dea-b388-d5bd997b5009 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.164414 Jun 18 08:10:19.607354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 227/454] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:19 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:20.245405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:20.246398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:20.257476 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.258214 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:20.259517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.260233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:20.322559 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:20.330165 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dc9d0a06-d2a1-479d-a2c4-1457f13b2fa9 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1223 microversion: 2.1 time: 0.091355 Jun 18 08:10:20.330735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 228/455] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:20 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:20.625711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:20.626315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:20.632963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.633401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:20.634154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.634612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:20.766763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:20.775719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:20.777215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:20.778384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c1ed241e-b10c-4202-a9f8-b928550bd4f3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.157069 Jun 18 08:10:20.778940 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 228/456] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:20 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:20.904155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:20.904740 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:20.911182 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.911636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:20.912406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:20.912844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:21.039239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lazy-loading 'services' on Instance uuid e15e626c-3e18-47cb-857d-b92aafddfbb4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:21.161272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9a624167-2144-4f93-be56-855ea2806e99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments/e9934e46-1b95-43f0-b002-b9be43357fe8" status: 202 len: 0 microversion: 2.1 time: 0.261214 Jun 18 08:10:21.161926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 229/457] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:10:20 2022] DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments/e9934e46-1b95-43f0-b002-b9be43357fe8 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:10:21.347202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:21.347799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:21.353932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:21.354348 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:21.355110 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:21.355533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:21.677088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:21.684647 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-210378d8-dfcf-4e57-adfa-17cd39bcb60b tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1215 microversion: 2.1 time: 0.341428 Jun 18 08:10:21.685224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 229/458] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:21 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:21.800025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:21.800703 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:21.807276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:21.807727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:21.808488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:21.808996 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:21.944679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:21.954273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:21.955835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:21.956982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-19f82ae4-4138-4e71-b739-c8d0608891a7 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.162993 Jun 18 08:10:21.957540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 230/459] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:21 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:22.334563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b941776-5f60-4823-8fba-3d5d862c046e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: .version_select at 0x7f3be4611310>, body: {"keypair": {"name": "tempest-keypair-17754154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG5HHdOPS+SWKDUkn+ok5Fik1y/4qzsHveW7H5Hz5OZEZ/Hx8ymi5RnkLPbKbrUefK5CI7Tx85pUQ6LH1aY8vI+xlwekmnWugdRdXa9MPaYDKe8W2DZTg65QSCGxqz0Yg=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:22.354066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-5b941776-5f60-4823-8fba-3d5d862c046e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:10:22.358271 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-5b941776-5f60-4823-8fba-3d5d862c046e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:10:22.405603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b941776-5f60-4823-8fba-3d5d862c046e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.074977 Jun 18 08:10:22.406513 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 230/460] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:10:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:22.705742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:22.706715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:22.717126 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:22.717645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:22.719156 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:22.719985 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:22.797744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-f2500d5b-44f2-4237-aee9-55298b0934b3 req-2ab39ade-e4b6-4c87-a1dc-dd9d27cbfe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "name": "network-vif-plugged", "status": "completed", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:22.823232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-f2500d5b-44f2-4237-aee9-55298b0934b3 req-2ab39ade-e4b6-4c87-a1dc-dd9d27cbfe5f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:22.823833 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-f2500d5b-44f2-4237-aee9-55298b0934b3 req-2ab39ade-e4b6-4c87-a1dc-dd9d27cbfe5f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:22.836189 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-f2500d5b-44f2-4237-aee9-55298b0934b3 req-2ab39ade-e4b6-4c87-a1dc-dd9d27cbfe5f service nova] Creating event network-vif-plugged:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:10:22.847411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-f2500d5b-44f2-4237-aee9-55298b0934b3 req-2ab39ade-e4b6-4c87-a1dc-dd9d27cbfe5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060933 Jun 18 08:10:22.848356 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 231/461] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:10:22.876333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:22.901789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c39742fe-b7b5-49ed-9a45-4dae97b5ab19 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1277 microversion: 2.1 time: 0.194566 Jun 18 08:10:22.903453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 231/462] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:22 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:22.980761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:22.981618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:22.988526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:22.989019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:22.989914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:22.990394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:23.191665 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:23.201146 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:23.203042 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:23.204227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-67e091bc-7e3f-44eb-acc9-cba187f8506a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.227893 Jun 18 08:10:23.204832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 232/463] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:22 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:23.352140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fda8efbe-d24b-4c6e-89d0-cea3c1e989aa tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:23.358899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fda8efbe-d24b-4c6e-89d0-cea3c1e989aa tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:23.359561 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fda8efbe-d24b-4c6e-89d0-cea3c1e989aa tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:23.398338 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fda8efbe-d24b-4c6e-89d0-cea3c1e989aa tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 08:10:23.461734 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fda8efbe-d24b-4c6e-89d0-cea3c1e989aa tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.113309 Jun 18 08:10:23.462800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 232/464] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:10:23 2022] POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:10:23.474770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:23.476014 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:23.483746 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:23.484524 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:23.485725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:23.486220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:23.506252 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:23.710606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:23.718700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-227f2838-2d31-4024-b408-d98a3e4b71d5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.249576 Jun 18 08:10:23.719364 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 233/465] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:23 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:23.921739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:23.923341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:23.932474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:23.933308 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:23.935958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:23.936511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:24.132212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:24.141073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2bb1546-65cc-49ae-bef5-41e6c53a9ea1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.225603 Jun 18 08:10:24.141644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 233/466] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:23 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:24.204866 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1256552307", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626"}], "security_groups": [{"name": "tempest-securitygroup--1585910642"}], "key_name": "tempest-keypair-17754154", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:24.224740 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:24.225343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:24.231671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:24.232192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:24.232979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:24.233401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:24.364508 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:24.366792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] validate_networks() for [('bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:10:24.373439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:24.374948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:24.376144 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b0f549ea-bc6c-495c-b61d-3c22762d9719 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.157037 Jun 18 08:10:24.376966 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 234/467] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:24 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:10:24.736782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:24.738137 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:24.744675 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:24.745122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:24.745885 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:24.746320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:24.765921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:24.893150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:24.900751 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ea97c7df-5fbe-41e0-b0e9-a4dedebf3b76 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.168143 Jun 18 08:10:24.901416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 235/468] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:24 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:24.989678 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:10:24.990470 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:10:24.991055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:10:24.991489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:10:24.991899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:10:25.002254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.002858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.003956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.004401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.022823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:10:25.027604 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:10:25.040723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:10:25.043148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:10:25.049112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-b0b091df-66fc-4a71-984d-5ba5e91d0abc req-4b59e6b0-3520-4128-8f95-6cf76e54d32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44787ebd-dffd-4b10-8b25-19253731e76e", "tag": "cdb895e1-a150-4a21-b0ed-78b7a58b6e44"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:25.079584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b0b091df-66fc-4a71-984d-5ba5e91d0abc req-4b59e6b0-3520-4128-8f95-6cf76e54d32c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.079584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b0b091df-66fc-4a71-984d-5ba5e91d0abc req-4b59e6b0-3520-4128-8f95-6cf76e54d32c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.095708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-b0b091df-66fc-4a71-984d-5ba5e91d0abc req-4b59e6b0-3520-4128-8f95-6cf76e54d32c service nova] Creating event network-changed:cdb895e1-a150-4a21-b0ed-78b7a58b6e44 for instance 44787ebd-dffd-4b10-8b25-19253731e76e on hv-cinder-82634 Jun 18 08:10:25.101783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-b0b091df-66fc-4a71-984d-5ba5e91d0abc req-4b59e6b0-3520-4128-8f95-6cf76e54d32c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056010 Jun 18 08:10:25.102696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 236/469] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:10:25.117951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8ce8fba3-35f0-4ce6-8c06-5e10d1e841a3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917394 Jun 18 08:10:25.118597 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 234/470] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:10:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:10:25.129109 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4df50848-8f64-4b28-94e2-69942d1dfcb1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:25.129793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4df50848-8f64-4b28-94e2-69942d1dfcb1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:25.158837 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:25.159466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:25.166259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.166699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.167494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.167927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.185589 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4df50848-8f64-4b28-94e2-69942d1dfcb1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:25.193141 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4df50848-8f64-4b28-94e2-69942d1dfcb1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1240 microversion: 2.1 time: 0.068217 Jun 18 08:10:25.193740 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 237/471] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:25 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:25.306759 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:25.315379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fe8e3e1-28fb-4771-91c4-a2d026609b59 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.160429 Jun 18 08:10:25.315951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 235/472] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:25 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:25.397866 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:25.398720 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:25.405547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.405994 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.406769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.407232 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.550976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:25.561040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:25.564135 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:25.565462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e0ffcc6-18ff-4589-9aa4-79653fb068af tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.174706 Jun 18 08:10:25.566029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 238/473] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:25 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:25.918051 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:25.918670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:25.925050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.925495 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:25.926270 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:25.926698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.136540 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.153100 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba81fb40-42f4-4568-b5a6-3f9d8a69ada9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.238352 Jun 18 08:10:26.160832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 236/474] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:25 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:26.210540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:26.211252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:26.218332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.219083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.220212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.220938 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.290653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.299482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e06eaa47-8eb6-4b86-b5a9-893fc97252de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1292 microversion: 2.1 time: 0.093483 Jun 18 08:10:26.300076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 239/475] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:26 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:26.332002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:26.332644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:26.340013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.340436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.341188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.341622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.564137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.572854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b096ca4f-cd47-42cf-b2a8-f8ca798e49dc tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.244741 Jun 18 08:10:26.573613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 237/476] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:26 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:26.588709 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:26.589551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:26.600560 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.601141 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.602023 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:26.602517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:26.789188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.801157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.802538 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:26.803832 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-578cdc4b-d9eb-455b-ae60-9709c786c197 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1806 microversion: 2.20 time: 0.220464 Jun 18 08:10:26.804640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 240/477] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:26 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:27.170181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:27.170859 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:27.177664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.178119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.178893 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.179352 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.312749 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.317587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:27.318204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:27.320815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d125e36e-6c60-4a4e-aaa5-2b8c48783854 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.154769 Jun 18 08:10:27.321613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 238/478] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:27 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:27.324944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.325391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.326153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.326564 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.390583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.399047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fbea101e-a41a-4c86-83e3-0827d52f1dd6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1310 microversion: 2.1 time: 0.085180 Jun 18 08:10:27.399823 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 241/479] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:27 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:10:27.592066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:27.592771 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:27.601753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.602388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.603453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.604083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.741144 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.748919 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e44c58d0-8bca-4b85-9bdb-9c4ba37c5ccf tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.162162 Jun 18 08:10:27.749495 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 239/480] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:27 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:27.823299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:27.823956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:27.830301 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.830748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.831534 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:27.831959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:27.984301 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.993944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.995597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:27.996834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-853ee351-8a19-47a4-b810-0a0a58ea9d7c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1793 microversion: 2.20 time: 0.177864 Jun 18 08:10:27.997390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 242/481] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:10:27 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1793 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:10:28.338043 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:28.338639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:28.340534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:28.346401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.346841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.347624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.348048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.416865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:28.417442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:28.424198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.424643 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.425398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.425804 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.488739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:28.496442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-15dc1fc0-e21c-400a-a927-22e273e29b5f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1298 microversion: 2.1 time: 0.083454 Jun 18 08:10:28.497000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 243/482] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:28 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:28.664586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:28.672921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e06e04be-1ef2-4419-896d-60883668b62b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.338788 Jun 18 08:10:28.673562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 240/483] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:28 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:28.766106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:28.766614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:28.772792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.773218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.773985 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:28.774409 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:28.911855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:28.919537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a687a725-c00a-44c7-8083-7851c5b66bc1 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.157513 Jun 18 08:10:28.920122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 244/484] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:28 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:29.513980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:29.516069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:29.523000 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.523767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.524827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.525994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.691671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:29.692727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:29.701190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.701663 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.702445 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.702874 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.745764 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:29.767955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a6ea3d21-f55a-4d99-8937-3dcf174c3dfd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.257698 Jun 18 08:10:29.777285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 241/485] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:29 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:29.782241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-835fc19a-292d-4114-bfe4-92f41f758d96 req-7c4ea529-48a6-4e2f-b6a8-7d21117a51a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f253692-d1ff-49e3-8583-70666337a4cd", "tag": "b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:29.800167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-835fc19a-292d-4114-bfe4-92f41f758d96 req-7c4ea529-48a6-4e2f-b6a8-7d21117a51a4 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.800601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-835fc19a-292d-4114-bfe4-92f41f758d96 req-7c4ea529-48a6-4e2f-b6a8-7d21117a51a4 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.812988 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-835fc19a-292d-4114-bfe4-92f41f758d96 req-7c4ea529-48a6-4e2f-b6a8-7d21117a51a4 service nova] Creating event network-changed:b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5 for instance 5f253692-d1ff-49e3-8583-70666337a4cd on hv-cinder-82634 Jun 18 08:10:29.817873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-835fc19a-292d-4114-bfe4-92f41f758d96 req-7c4ea529-48a6-4e2f-b6a8-7d21117a51a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040755 Jun 18 08:10:29.818671 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 242/486] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:29.875111 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:29.883398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bed1a09d-f7ee-4025-a6b8-dc26ad837b4d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.197127 Jun 18 08:10:29.884134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 245/487] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:29 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:29.937969 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:29.938650 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:29.946229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.946643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:29.947485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:29.948165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:30.420369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:30.428120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2ef19d52-9705-44f3-8ff3-4f065710c691 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.495256 Jun 18 08:10:30.428745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 243/488] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:29 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:30.785080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:30.785691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:30.792435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:30.792976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:30.793746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:30.794176 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:30.899984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:30.900789 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:30.907644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:30.908422 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:30.909190 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:30.909846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:30.933312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:30.941455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2379f627-898c-4e92-8473-608e3f106faa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.160293 Jun 18 08:10:30.942049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 246/489] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:30 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:31.046013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:31.053852 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7bf7fef5-484b-483a-9398-8dcbb359733e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.157870 Jun 18 08:10:31.054424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 244/490] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:30 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:31.446433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:31.447212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:31.455158 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:31.455705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:31.456638 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:31.457187 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:31.605715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:31.617195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c0fbaf8c-c921-4d36-99eb-90959aaf71c5 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.175342 Jun 18 08:10:31.617962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 247/491] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:31 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:31.958076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:31.958637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:31.966209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:31.966589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:31.967376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:31.967788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.071705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:32.072433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:32.079428 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:32.079945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.080651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:32.081084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.170163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:32.179336 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17981ea6-a00f-4dc4-98dc-8736489797a0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.224038 Jun 18 08:10:32.180037 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 245/492] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:31 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:32.212266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:32.219876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-481f7c46-f0ba-459c-a807-4c45b80b311f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.152121 Jun 18 08:10:32.220427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 248/493] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:32 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:32.634614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:32.635250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:32.641781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:32.642227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.642990 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:32.643452 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.778323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-b3c7270e-8214-4b4f-ab5f-9e24ea7bbe24 req-6980b8e5-85a4-450b-a689-583955b99919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44787ebd-dffd-4b10-8b25-19253731e76e", "name": "network-vif-plugged", "status": "completed", "tag": "cdb895e1-a150-4a21-b0ed-78b7a58b6e44"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:32.778517 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:32.786867 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b3c7270e-8214-4b4f-ab5f-9e24ea7bbe24 req-6980b8e5-85a4-450b-a689-583955b99919 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:32.787374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b3c7270e-8214-4b4f-ab5f-9e24ea7bbe24 req-6980b8e5-85a4-450b-a689-583955b99919 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:32.788192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f5d89c25-fa0b-4db1-9104-027c8ce34f01 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.157333 Jun 18 08:10:32.806077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 246/494] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:32 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:32.808706 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-b3c7270e-8214-4b4f-ab5f-9e24ea7bbe24 req-6980b8e5-85a4-450b-a689-583955b99919 service nova] Creating event network-vif-plugged:cdb895e1-a150-4a21-b0ed-78b7a58b6e44 for instance 44787ebd-dffd-4b10-8b25-19253731e76e on hv-cinder-82634 Jun 18 08:10:32.813954 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-b3c7270e-8214-4b4f-ab5f-9e24ea7bbe24 req-6980b8e5-85a4-450b-a689-583955b99919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 Jun 18 08:10:32.814547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 249/495] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:33.200821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:33.201799 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:33.212800 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.213536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.214777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.215511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.238068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:33.239398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:33.245945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.246388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.247171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.247600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.351941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:33.359826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ee8575d3-4370-4641-b1af-8b9efe7f9976 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.165525 Jun 18 08:10:33.360400 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 247/496] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:33 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:33.382580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:33.390384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ee9d7b1-c9e0-436c-9202-f805df136124 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1676 microversion: 2.1 time: 0.157043 Jun 18 08:10:33.390991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 250/497] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:33 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:33.809701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:33.810693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:33.819532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.819975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.820731 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:33.821160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:33.952999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:33.961045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-082f0199-e0e2-466f-a5fb-987ce81eb8c4 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1319 microversion: 2.1 time: 0.157938 Jun 18 08:10:33.961612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 248/498] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:33 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:34.377154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:34.377782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:34.384406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.384834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.385588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.386009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.408537 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:34.409787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:34.416719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.417153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.417902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.418321 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.520274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:34.527627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3823fab3-20d2-4d8a-b93d-3dba560c4513 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.154372 Jun 18 08:10:34.528183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 251/499] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:34 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:34.556581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:34.567633 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-60c24d3f-b39c-42c4-899f-098b71e6d8f0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1653 microversion: 2.1 time: 0.162946 Jun 18 08:10:34.568228 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 249/500] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:34 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:34.584040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-76cc8dc2-2bfb-4b6f-afd4-4e417cadffb0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:34.590402 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76cc8dc2-2bfb-4b6f-afd4-4e417cadffb0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.590865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76cc8dc2-2bfb-4b6f-afd4-4e417cadffb0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.613374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-76cc8dc2-2bfb-4b6f-afd4-4e417cadffb0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Going to try to start instance {{(pid=117615) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 08:10:34.655738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-76cc8dc2-2bfb-4b6f-afd4-4e417cadffb0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action" status: 202 len: 0 microversion: 2.1 time: 0.075246 Jun 18 08:10:34.656277 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 252/501] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:10:34 2022] POST /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:10:34.664719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:34.665315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:34.671341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.671783 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.672501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.672929 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.800542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:34.808549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-021365ee-79e5-4cfc-8e36-fdc7269fad53 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1662 microversion: 2.1 time: 0.147759 Jun 18 08:10:34.809347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 250/502] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:34 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:34.978645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:34.979263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:34.985633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.986073 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:34.986820 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:34.987278 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.005846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:35.093563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ef5c34-36b7-4e2c-b0e8-8bb0c640302e"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:35.096583 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:35.100614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:35.101345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=16 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:35.106050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.106585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.107701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.108060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.126362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:35.131335 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:35.140407 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ef1b3067-99f9-4497-8959-c2364997903f tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1508 microversion: 2.1 time: 0.166131 Jun 18 08:10:35.141689 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 253/503] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:34 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:35.157191 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dcbf86a-0b77-43a3-a599-6b3be316b314", "device": "/dev/sdb"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:35.158369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:35.164470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.164919 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.165679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.166106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.189794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:35.429688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f1eeb6f-5949-4561-b2a3-d7c4fac7022f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340520 Jun 18 08:10:35.430986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 251/504] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:10:35 2022] POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:35.475250 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b64206b8-f40d-432d-b09b-cea35f46820c tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "POST /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321700 Jun 18 08:10:35.479199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 254/505] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:10:35 2022] POST /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:35.546711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:35.547532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:35.555795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.557112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.557894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.558358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.693745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:35.701296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c738ab4d-0ef4-40b6-8030-8591f74cb911 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.159415 Jun 18 08:10:35.701862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 252/506] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:35 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:35.833320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:35.833907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:35.840527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.840969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.841720 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:35.842143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:35.972327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:35.980393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4b921476-cd78-48ad-8b0b-d9cc61476588 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1662 microversion: 2.1 time: 0.154248 Jun 18 08:10:35.980984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 255/507] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:35 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:36.718861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:36.719587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:36.726426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:36.726954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:36.727802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:36.728316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:36.796642 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e7c0b424-7abd-4d6c-9aed-5975ebc47360 req-07caec76-07b5-4652-ab4e-73d8f448f2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f253692-d1ff-49e3-8583-70666337a4cd", "name": "network-vif-plugged", "status": "completed", "tag": "b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:36.805484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7c0b424-7abd-4d6c-9aed-5975ebc47360 req-07caec76-07b5-4652-ab4e-73d8f448f2a9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:36.806241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7c0b424-7abd-4d6c-9aed-5975ebc47360 req-07caec76-07b5-4652-ab4e-73d8f448f2a9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:36.820122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e7c0b424-7abd-4d6c-9aed-5975ebc47360 req-07caec76-07b5-4652-ab4e-73d8f448f2a9 service nova] Creating event network-vif-plugged:b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5 for instance 5f253692-d1ff-49e3-8583-70666337a4cd on hv-cinder-82634 Jun 18 08:10:36.825442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e7c0b424-7abd-4d6c-9aed-5975ebc47360 req-07caec76-07b5-4652-ab4e-73d8f448f2a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032651 Jun 18 08:10:36.826327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 256/508] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:10:36.873599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:36.881874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5bb54acf-7ad5-443c-a6bd-705518390a53 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.167265 Jun 18 08:10:36.882886 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 253/509] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:36 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:36.999437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:37.000196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:37.007642 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:37.008153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:37.008990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:37.009505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:37.141465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:37.149441 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e5a8986f-d54b-4929-823a-7b199068ad7e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1666 microversion: 2.1 time: 0.155364 Jun 18 08:10:37.150051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 257/510] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:36 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:37.903527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:37.904585 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:37.913460 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:37.913899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:37.914650 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:37.915110 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:38.054897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:38.063199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-380077aa-7d50-417a-97a5-623a70e88f13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1366 microversion: 2.1 time: 0.166232 Jun 18 08:10:38.063774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 254/511] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:37 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:39.083845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:39.084482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:39.094388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:39.095058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:39.096153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:39.096679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:39.233549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:39.241459 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a92841ea-89f8-4782-835c-5fd786d9ea25 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1557 microversion: 2.1 time: 0.163922 Jun 18 08:10:39.242038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 258/512] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:39 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:39.262978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:39.263550 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:39.270212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:39.270659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:39.271461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:39.271888 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:39.356538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-75e01a50-ef93-465a-b454-a1ba38efc902 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097063 Jun 18 08:10:39.357388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:10:39 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:10:40.292456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-da7f7811-8b3a-4f70-92d9-88ada3d31da8 req-f9b9b41f-a7ee-4bfd-959b-406bfd23a596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f253692-d1ff-49e3-8583-70666337a4cd", "tag": "b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:40.301281 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-da7f7811-8b3a-4f70-92d9-88ada3d31da8 req-f9b9b41f-a7ee-4bfd-959b-406bfd23a596 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:40.301736 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-da7f7811-8b3a-4f70-92d9-88ada3d31da8 req-f9b9b41f-a7ee-4bfd-959b-406bfd23a596 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:40.313906 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-da7f7811-8b3a-4f70-92d9-88ada3d31da8 req-f9b9b41f-a7ee-4bfd-959b-406bfd23a596 service nova] Creating event network-changed:b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5 for instance 5f253692-d1ff-49e3-8583-70666337a4cd on hv-cinder-82634 Jun 18 08:10:40.318447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-da7f7811-8b3a-4f70-92d9-88ada3d31da8 req-f9b9b41f-a7ee-4bfd-959b-406bfd23a596 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029689 Jun 18 08:10:40.319244 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 259/514] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:10:44.055887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:10:44.056861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:44.064013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:44.064456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:44.065270 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:44.065696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:44.089548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'flavor' on Instance uuid 7757ca67-53be-42e1-b461-bbaea10664e6 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:10:44.224601 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dd28dad6-6029-499c-b4e6-d3072fcdfa4b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/action" status: 200 len: 32 microversion: 2.1 time: 0.172789 Jun 18 08:10:44.225325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 256/515] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:10:44 2022] POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:10:44.235808 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:44.236495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:44.243287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:44.243774 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:44.244544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:44.244975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:44.376103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:44.384450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4cbd7bbf-194c-4a8c-9f8c-6816b71ab388 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.153486 Jun 18 08:10:44.385033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 260/516] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:44 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:45.407776 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:45.408904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:45.419651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:45.420402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:45.421675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:45.422361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:45.560793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:45.573590 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cf09041e-00d2-44a3-a5b1-05e2fe6403a5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.174383 Jun 18 08:10:45.574241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 257/517] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:45 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:46.593882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:46.594452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:46.597098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=76 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:46.602673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:46.603130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:46.603883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:46.604307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:46.736941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:46.748945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ba84523a-2512-46b5-a87c-d754ac9adc6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.158832 Jun 18 08:10:46.749576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 261/518] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:46 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:47.770846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:47.771750 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:47.782875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:47.783659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:47.784903 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:47.785623 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:47.921967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:47.931759 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-52b7a72b-b2bd-4c66-ae8a-522c5b042c86 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.167747 Jun 18 08:10:47.932326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 258/519] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:47 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:48.957884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:48.958879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:48.969991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:48.970744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:48.972081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:48.972737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:49.112448 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:49.120777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f86e30ee-a2c1-46a9-aaa3-2ac6fa565cdd tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.169488 Jun 18 08:10:49.121358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 262/520] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:48 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:50.137890 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:50.138574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:50.146981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:50.147455 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:50.148205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:50.148625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:50.303989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:50.313114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d7f27289-b415-4697-8be0-eba44213042e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.178975 Jun 18 08:10:50.314077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 259/521] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:50 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:51.330025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:51.330631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:51.337636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:51.338081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:51.338845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:51.339302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:51.480669 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:51.489331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-661919e8-c30d-4b2d-80f3-6c70973c919c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.163149 Jun 18 08:10:51.489888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 263/522] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:51 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:52.506955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:52.507609 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:52.514254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:52.514694 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:52.515467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:52.515889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:52.657016 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:52.665424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-19c35467-3257-4f78-ae4f-6d850a74a681 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.162435 Jun 18 08:10:52.665993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 260/523] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:52 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:10:53.685600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:53.686546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:53.696770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:53.697471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:53.698091 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:53.698808 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:53.833153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:53.841715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a10c3c2c-2b6c-4b37-abab-50084bfaa694 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.162257 Jun 18 08:10:53.842309 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 264/524] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:53 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:54.866391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:54.867020 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:54.876457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:54.876769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:54.877637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:54.878324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:55.026395 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:55.038102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-523e17eb-dfa0-41e0-b007-848d48bff270 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.177068 Jun 18 08:10:55.038683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 261/525] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:54 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:56.058616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:56.059695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:56.071080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:56.071816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:56.073052 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:56.073752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:56.208927 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:56.217395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-55943801-8868-4b17-92a7-d54da9999cd2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.165163 Jun 18 08:10:56.217946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 265/526] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:56 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:57.237861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:57.238792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:57.249933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:57.250661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:57.251975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:57.252681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:57.625527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:57.634052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e5d5ef87-af78-45a6-b32e-809d0375b04c tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.402659 Jun 18 08:10:57.634613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 262/527] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:57 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:58.651760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:58.652401 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:58.659061 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:58.659516 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:58.660278 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:58.660713 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:58.792344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:58.800667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2e1c6ae2-76b5-4ae8-97ba-dc33f8af737a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.153001 Jun 18 08:10:58.801287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 266/528] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:58 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:10:59.822234 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:10:59.823072 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:10:59.826875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=46 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:10:59.835150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:59.835583 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:59.836347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:10:59.836784 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:10:59.979964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:10:59.992393 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44d8dd58-4519-493f-9f9c-f7f8956e6eec tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.176670 Jun 18 08:10:59.993178 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 263/529] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:10:59 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:01.017329 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:01.018316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:01.029364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:01.030114 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:01.031441 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:01.032200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:01.172627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:01.181186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b313a41d-6091-46ec-a4e8-f5a6e6620d1d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.170250 Jun 18 08:11:01.181759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 267/530] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:01 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:02.202666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:02.203900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:02.213048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:02.213486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:02.214237 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:02.214659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:02.291506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:02.292034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:02.298615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:02.299109 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:02.299828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:02.300312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:02.344418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:02.352524 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c9ce41f0-8af0-43ff-a397-555ff8556c6f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.156723 Jun 18 08:11:02.353094 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 264/531] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:02 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:02.379900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'services' on Instance uuid 44787ebd-dffd-4b10-8b25-19253731e76e {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:02.456377 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9b3294d4-2765-4e4c-8df4-889744050776 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e/os-volume_attachments/5dcbf86a-0b77-43a3-a599-6b3be316b314" status: 202 len: 0 microversion: 2.1 time: 0.168652 Jun 18 08:11:02.456933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 268/532] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:11:02 2022] DELETE /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e/os-volume_attachments/5dcbf86a-0b77-43a3-a599-6b3be316b314 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:11:03.373900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:03.374845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:03.385770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:03.386513 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:03.387811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:03.388522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:03.395210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:03.533179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:03.541821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-de37ac21-fb50-4052-9e03-2f7ce049a44f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.174557 Jun 18 08:11:03.544889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 265/533] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:03 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:04.564990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:04.566127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:04.573957 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.574883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.575188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.575618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.593852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:04.625443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:04.626001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:04.632605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.633055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.633813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.634241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.660995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:04.711202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:04.719270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7832366-503f-45fb-bc55-5c40b702d3bf tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.162551 Jun 18 08:11:04.719871 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 269/534] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:04 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:04.752875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7d53732b-65d5-4aed-9551-fa86bde8a9fe tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "DELETE /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 204 len: 0 microversion: 2.1 time: 0.131140 Jun 18 08:11:04.753680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 266/535] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:11:04 2022] DELETE /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 08:11:04.761796 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:04.762410 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:04.768642 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.769084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.769843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:04.770266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:04.907799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:04.915470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f0c198ca-43d8-48ca-8be5-f5dbfdbc3472 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1514 microversion: 2.1 time: 0.157506 Jun 18 08:11:04.916036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 270/536] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:04 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:05.742574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:05.743774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:05.754684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:05.755539 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:05.756796 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:05.757541 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:05.900474 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:05.908804 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6b9e12ea-2c31-4af9-b005-5fdf54d9f740 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.173480 Jun 18 08:11:05.909375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 267/537] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:05 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:05.932708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:05.933325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:05.940702 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:05.941142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:05.941891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:05.942314 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:06.076432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:06.088149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5336dd25-29c6-4ff7-9fd6-841c1cfbe20a tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1514 microversion: 2.1 time: 0.159117 Jun 18 08:11:06.088753 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 271/538] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:05 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:06.925937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:06.926711 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:06.933457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:06.933947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:06.934719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:06.935194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:07.106044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:07.106637 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:07.113377 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:07.113833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:07.114595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:07.115161 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:07.142967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:07.151687 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8689a5e0-a6e5-4280-b8d1-651caa8a19ae tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.229648 Jun 18 08:11:07.152274 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 268/539] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:06 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:07.245012 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:07.252732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5903d4a2-0171-429e-a1ae-ac21a46900db tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1514 microversion: 2.1 time: 0.150715 Jun 18 08:11:07.253302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 272/540] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:07 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:07.376120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-992aed83-b492-4f19-bd5d-7131b76584a9 req-91c1fbf9-1738-4ac9-8a40-2bd5a85df382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44787ebd-dffd-4b10-8b25-19253731e76e", "name": "network-vif-deleted", "tag": "cdb895e1-a150-4a21-b0ed-78b7a58b6e44"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:07.384917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-992aed83-b492-4f19-bd5d-7131b76584a9 req-91c1fbf9-1738-4ac9-8a40-2bd5a85df382 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:07.385348 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-992aed83-b492-4f19-bd5d-7131b76584a9 req-91c1fbf9-1738-4ac9-8a40-2bd5a85df382 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:07.396034 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-992aed83-b492-4f19-bd5d-7131b76584a9 req-91c1fbf9-1738-4ac9-8a40-2bd5a85df382 service nova] Creating event network-vif-deleted:cdb895e1-a150-4a21-b0ed-78b7a58b6e44 for instance 44787ebd-dffd-4b10-8b25-19253731e76e on hv-cinder-82634 Jun 18 08:11:07.400772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-992aed83-b492-4f19-bd5d-7131b76584a9 req-91c1fbf9-1738-4ac9-8a40-2bd5a85df382 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028464 Jun 18 08:11:07.401347 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 269/541] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:08.168944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:08.170009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:08.178232 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:08.178681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:08.179480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:08.179908 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:08.271558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:08.272279 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:08.283424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:08.284297 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:08.285109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:08.285732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:08.321033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:08.329213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:08.329654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:08.330105 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lazy-loading 'fault' on Instance uuid 44787ebd-dffd-4b10-8b25-19253731e76e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:08.330384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-235593d2-34a3-4ad5-ba54-2b14d347f781 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.165453 Jun 18 08:11:08.330966 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 273/542] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:08 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:08.371306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c918c712ffb945f3b21bd76de9f22115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53dba3c495141569fc1a011b51023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:08.378709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b69ee2d7-885f-4a0f-a679-f4bc7643b6ed tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 200 len: 1309 microversion: 2.1 time: 0.112645 Jun 18 08:11:08.379390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 270/543] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:08 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:09.351747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:09.352610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:09.363809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:09.364547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:09.365491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:09.365922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:09.396024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:09.396616 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] [instance: 44787ebd-dffd-4b10-8b25-19253731e76e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:09.403702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:09.404150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:09.404916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:09.405592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:09.419871 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] HTTP exception thrown: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Request method failure captured: Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e HTTP/1.1 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYf867jcmFp36QPQMsAs5IGgL7kzImf5yz_PFN3y0VdWIqYqTqMNBi-ehdKmDzchjZx0JSMnIGSxl29__1mehKmtbvw6IB5TjjwYta0tX5VkwIYbWPAMhzdnBxExH0s9Y_uNK2sRqLBAuCZbzusppReSumMpemEteLMgIvqGJmmSKuE Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c53dba3c495141569fc1a011b51023b2 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:09.421544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c53dba3c495141569fc1a011b51023b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c53dba3c495141569fc1a011b51023b2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c53dba3c495141569fc1a011b51023b2 Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2020409798 Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotTestJSON-2020409798-project Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: c918c712ffb945f3b21bd76de9f22115 Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotTestJSON-2020409798-project Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. Jun 18 08:11:09.423152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '44787ebd-dffd-4b10-8b25-19253731e76e'} Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:09.423950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. Jun 18 08:11:09.425158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:09.426248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] Returning 404 to user: Instance 44787ebd-dffd-4b10-8b25-19253731e76e could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:09.426248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3965a901-6553-47da-b126-645a591e2a04 tempest-VolumesSnapshotTestJSON-2020409798 tempest-VolumesSnapshotTestJSON-2020409798-project] 10.222.0.23 "GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e" status: 404 len: 111 microversion: 2.1 time: 0.030940 Jun 18 08:11:09.426248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 271/544] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:09 2022] GET /compute/v2.1/servers/44787ebd-dffd-4b10-8b25-19253731e76e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:11:09.504370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:09.512471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-43a9ceb2-36a9-4e98-a1a4-f60b24143e01 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.167461 Jun 18 08:11:09.513048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 274/545] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:09 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:10.534271 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:10.535265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:10.542871 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:10.543142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:10.543908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:10.544346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:10.682468 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:10.691454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-baf39a11-e448-4bb2-aabc-2cf6d3ea966d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1735 microversion: 2.1 time: 0.163846 Jun 18 08:11:10.692033 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 272/546] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:10 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:11.713795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:11.714776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:11.725920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:11.726626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:11.728027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:11.728746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:11.861142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:11.869786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-47b0866f-1895-449a-a496-432bf5392169 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1715 microversion: 2.1 time: 0.162599 Jun 18 08:11:11.870353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 275/547] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:11 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:11.978376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:11.978870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:11.985628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:11.986067 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:11.986814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:11.987275 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:12.069781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] HTTP exception thrown: Cannot 'detach_volume' instance 7757ca67-53be-42e1-b461-bbaea10664e6 while it is in vm_state rescued Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Request method failure captured: Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments/04ef5c34-36b7-4e2c-b0e8-8bb0c640302e HTTP/1.1 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYen-2sGjB4XSmK77OS9Uj6OBn3ySfH8juXZ-HV2P_kSMz_IN71w4LPGiZ17uk2sONdCnqZ8BNIszDzBmJyvg7sCBPtVifUTezq51ZvE524S0zFh40PZTubZYw1ykx_eqYWh_Hdr_msQ_KfGwxptBAdOJQKRHRoaMAupxnE4YmhB9DY Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:12.071331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bc66714da4345ddb2639465d29fcae0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 62c79651096b4ac3a7414e70c8bdcd7e Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:12.072874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Cannot 'detach_volume' instance 7757ca67-53be-42e1-b461-bbaea10664e6 while it is in vm_state rescued Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '7757ca67-53be-42e1-b461-bbaea10664e6', 'id': '04ef5c34-36b7-4e2c-b0e8-8bb0c640302e'} Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:12.073652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7757ca67-53be-42e1-b461-bbaea10664e6 while it is in vm_state rescued Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7757ca67-53be-42e1-b461-bbaea10664e6 while it is in vm_state rescued Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:12.075121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Returning 409 to user: Cannot 'detach_volume' instance 7757ca67-53be-42e1-b461-bbaea10664e6 while it is in vm_state rescued {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:12.076303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-983c4148-c4eb-4ec3-b8d4-d486a65d3a8d tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments/04ef5c34-36b7-4e2c-b0e8-8bb0c640302e" status: 409 len: 152 microversion: 2.1 time: 0.099439 Jun 18 08:11:12.076303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 273/548] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:11:11 2022] DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments/04ef5c34-36b7-4e2c-b0e8-8bb0c640302e => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 08:11:12.081732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:12.082263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:12.088708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:12.089149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:12.089907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:12.090343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:12.156571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-550742f1-6f2f-42c3-8527-4c4c46e83cfa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/action" status: 202 len: 0 microversion: 2.1 time: 0.078531 Jun 18 08:11:12.157201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 276/549] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:11:12 2022] POST /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 08:11:12.165409 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:12.166013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:12.172066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:12.172524 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:12.173332 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:12.173745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:12.315342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:12.323535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9422a1dc-b93a-4cb2-a577-983d4ecb492f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1723 microversion: 2.1 time: 0.162045 Jun 18 08:11:12.324101 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 274/550] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:12 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:13.348859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:13.349989 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:13.360896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:13.361611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:13.363053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:13.363750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:13.512113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:13.524379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f31dafa-cd40-4e2c-a2ba-de4a106066d9 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1723 microversion: 2.1 time: 0.183710 Jun 18 08:11:13.525124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 277/551] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:13 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:14.546845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:14.547593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:14.556584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:14.557029 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:14.557836 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:14.558260 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:14.710502 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:14.719496 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e13828f2-f3c3-429c-a4eb-fc02a9e1a74a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1723 microversion: 2.1 time: 0.179773 Jun 18 08:11:14.720046 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 275/552] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:14 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:15.741100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:15.742150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:15.753195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:15.753918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:15.755222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:15.755932 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:15.888877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:15.897051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dff944be-8be7-4aef-95b8-03f6e8845985 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1723 microversion: 2.1 time: 0.162781 Jun 18 08:11:15.897620 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 278/553] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:15 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:16.914184 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:16.914806 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:16.921643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:16.922054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:16.922834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:16.923304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.049215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:17.057285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f1a91907-d9c9-4093-8b51-cee92df8b65b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1723 microversion: 2.1 time: 0.147226 Jun 18 08:11:17.057854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 276/554] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:16 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:11:17.660063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:17.660623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:17.663035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=36 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:17.668201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.668628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.669377 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.669798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.699054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-694bcd28-a281-40d4-b0cc-dd05d18cf4d1 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments/457f4d49-b04e-41f2-83e5-eea8fc1d80da" status: 200 len: 194 microversion: 2.20 time: 0.043006 Jun 18 08:11:17.699686 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 279/555] 10.222.0.23 () {60 vars in 1453 bytes} [Sat Jun 18 08:11:17 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments/457f4d49-b04e-41f2-83e5-eea8fc1d80da => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:11:17.762452 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:17.762948 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:17.769500 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.769958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.770724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.771222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.861889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lazy-loading 'services' on Instance uuid ab6e7d6f-1ab3-489b-938f-60eed0962e00 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:17.947376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e1b7e64b-3dcc-4c37-9a8e-cb065bd2b95f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments/457f4d49-b04e-41f2-83e5-eea8fc1d80da" status: 202 len: 0 microversion: 2.20 time: 0.188516 Jun 18 08:11:17.948220 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 277/556] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Jun 18 08:11:17 2022] DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments/457f4d49-b04e-41f2-83e5-eea8fc1d80da => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:11:17.956402 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:17.957404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:17.963529 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.963967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.964757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:17.965186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:17.994492 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e1261bd2-67e7-4e0c-8d83-2ed7b7a0a5d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042031 Jun 18 08:11:17.995060 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 280/557] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 08:11:17 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:11:18.075377 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:18.076078 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:18.082825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:18.083296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:18.084096 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:18.084744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:18.213774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:18.221893 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-32a1a93d-5e13-47aa-a976-496f89c1c58e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1729 microversion: 2.1 time: 0.150863 Jun 18 08:11:18.222470 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 278/558] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:18 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:18.238739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:18.239250 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:18.246503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:18.247051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:18.247840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:18.248276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:18.332044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4450c85f-1c9d-48be-8473-fc4812819b51 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096609 Jun 18 08:11:18.332867 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 281/559] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:11:18 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:19.006692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:19.008428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:19.016984 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:19.017766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:19.018798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:19.019304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:19.058428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4eb2e65c-bda6-4578-9aff-bd69a2c664ce tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056149 Jun 18 08:11:19.065343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 279/560] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 08:11:19 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:11:19.228739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-89b3c961-190b-44dc-822d-91077e94cc07 req-9def375f-be5c-4e42-95da-9655efedd145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:19.237495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-89b3c961-190b-44dc-822d-91077e94cc07 req-9def375f-be5c-4e42-95da-9655efedd145 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:19.238170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-89b3c961-190b-44dc-822d-91077e94cc07 req-9def375f-be5c-4e42-95da-9655efedd145 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:19.250020 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-89b3c961-190b-44dc-822d-91077e94cc07 req-9def375f-be5c-4e42-95da-9655efedd145 service nova] Creating event network-changed:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:11:19.255683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-89b3c961-190b-44dc-822d-91077e94cc07 req-9def375f-be5c-4e42-95da-9655efedd145 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030696 Jun 18 08:11:19.256640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 282/561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:20.073000 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:20.073936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:20.080666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.081111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.081894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.082316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.098926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:20.112454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-777ca433-8a37-4996-90e5-08a6252b460f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043512 Jun 18 08:11:20.113003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 280/562] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 08:11:20 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:20.171315 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:20.172185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:20.178486 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.178902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.179692 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.180108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.204674 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:20.283413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cc519536-2bbb-4143-924e-200f03b18d54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 204 len: 0 microversion: 2.20 time: 0.116234 Jun 18 08:11:20.284090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 283/563] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 08:11:20 2022] DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 08:11:20.292345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:20.292949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:20.299727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.300173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.300916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:20.301341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:20.479440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:20.487523 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:20.488994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:20.490139 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0b061a74-5eb2-4393-ac06-a77b13d4e2dc tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.201789 Jun 18 08:11:20.490706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 281/564] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:20 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:11:21.279033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-f4613e55-3f94-4fa8-9141-179b9b13f475 req-05513f8b-4d93-44ec-908c-143307db45ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:21.289425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f4613e55-3f94-4fa8-9141-179b9b13f475 req-05513f8b-4d93-44ec-908c-143307db45ae service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:21.290086 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f4613e55-3f94-4fa8-9141-179b9b13f475 req-05513f8b-4d93-44ec-908c-143307db45ae service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:21.301320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-f4613e55-3f94-4fa8-9141-179b9b13f475 req-05513f8b-4d93-44ec-908c-143307db45ae service nova] Creating event network-changed:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:11:21.307252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-f4613e55-3f94-4fa8-9141-179b9b13f475 req-05513f8b-4d93-44ec-908c-143307db45ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033383 Jun 18 08:11:21.307824 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 284/565] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:21.512320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:21.513192 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:21.524730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:21.525355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:21.526123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:21.526567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:21.656536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:21.665149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:21.666709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:21.667901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ad2ae055-c441-408a-9637-6464bbe01a17 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.162385 Jun 18 08:11:21.668470 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 282/566] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:21 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:22.692309 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:22.693422 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:22.701425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:22.701865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:22.702651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:22.703098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:22.707155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:22.840488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:22.849201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:22.850687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:22.851876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7290939c-5ecd-4ed9-aeed-506b9b3ddfbe tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.167944 Jun 18 08:11:22.855462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 285/567] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:22 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:23.874337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:23.874930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:23.881824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:23.882266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:23.883030 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:23.883507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:24.068542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:24.077163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:24.078752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:24.079963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c0ab230b-5831-4568-b90f-0d833d7b5270 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.209584 Jun 18 08:11:24.080710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 283/568] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:23 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:25.097824 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:25.098671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:25.105618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:25.106847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:25.107852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:25.108297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:25.245771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:25.254006 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:25.255520 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:25.256683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3faf2f9b-c015-4d53-8764-1de3318e8029 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1721 microversion: 2.20 time: 0.162815 Jun 18 08:11:25.257233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 286/569] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:25 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:25.998340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e9d35e91-69cf-41a3-b3c9-ac68107be445 req-3d1f1fd6-0f5f-4972-9e1a-5e165cb32135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e7d6f-1ab3-489b-938f-60eed0962e00", "name": "network-vif-deleted", "tag": "3d6a72a8-a827-40a1-a433-2fdd5bd23450"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:26.009657 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e9d35e91-69cf-41a3-b3c9-ac68107be445 req-3d1f1fd6-0f5f-4972-9e1a-5e165cb32135 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:26.010020 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e9d35e91-69cf-41a3-b3c9-ac68107be445 req-3d1f1fd6-0f5f-4972-9e1a-5e165cb32135 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:26.023566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e9d35e91-69cf-41a3-b3c9-ac68107be445 req-3d1f1fd6-0f5f-4972-9e1a-5e165cb32135 service nova] Creating event network-vif-deleted:3d6a72a8-a827-40a1-a433-2fdd5bd23450 for instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 on hv-cinder-82634 Jun 18 08:11:26.029629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e9d35e91-69cf-41a3-b3c9-ac68107be445 req-3d1f1fd6-0f5f-4972-9e1a-5e165cb32135 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034688 Jun 18 08:11:26.031128 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 284/570] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:26.277121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:26.277121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:26.284658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:26.284658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:26.285021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:26.285572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:26.321448 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:26.321929 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:26.322370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lazy-loading 'fault' on Instance uuid ab6e7d6f-1ab3-489b-938f-60eed0962e00 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:26.363787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:26.371849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:26.373337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:26.374502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a974e38-617b-4255-a968-a2a5174f6d46 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 200 len: 1370 microversion: 2.20 time: 0.103333 Jun 18 08:11:26.375099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 287/571] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:26 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:27.395570 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:27.396271 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:27.404172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:27.404591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:27.405356 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:27.405785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:27.419435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 HTTP/1.1 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:27.421087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:11:27.422717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'ab6e7d6f-1ab3-489b-938f-60eed0962e00'} Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:27.423740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:11:27.425040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:27.426316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:27.426316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8abe3822-d9a7-485a-974c-21b57e725c4b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 404 len: 111 microversion: 2.20 time: 0.031970 Jun 18 08:11:27.426316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 285/572] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:27 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:11:27.431631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bbcb6218-de3a-49b9-852f-e1e28e2dd94a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '.version_select at 0x7f3bdf3309d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:27.452224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bbcb6218-de3a-49b9-852f-e1e28e2dd94a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422127038" status: 204 len: 0 microversion: 2.20 time: 0.024546 Jun 18 08:11:27.452855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 288/573] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Jun 18 08:11:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422127038 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 08:11:28.110206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-538cdf26-0f0b-4991-8260-ec7f2415a965 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: .version_select at 0x7f3be41edf70>, body: {"keypair": {"name": "tempest-keypair-2012300379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbo8hF0IRyKAOFe9WkT5AI8BU+fAG/53UROkUR3hYKyI2/NPpp8bg5ul1slqg2QbbW9P3G9o5bcBf7XYcTH+k9iXhJd+Vl4+kUuAzFHT9Mokia9ji52HTHScIdcn41shQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:28.125207 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-538cdf26-0f0b-4991-8260-ec7f2415a965 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for project fc9abdfe8063473abfa91f578081eb0d. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:28.132297 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-538cdf26-0f0b-4991-8260-ec7f2415a965 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for user 39cd1520458f49df9ff4edb63c09f746 and project fc9abdfe8063473abfa91f578081eb0d. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:28.154510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-538cdf26-0f0b-4991-8260-ec7f2415a965 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048237 Jun 18 08:11:28.155133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 286/574] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Jun 18 08:11:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 08:11:29.484096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2051957676", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7f79979-914c-42cc-bb29-5a94ac49a40c"}], "security_groups": [{"name": "tempest-securitygroup--1647404763"}], "key_name": "tempest-keypair-2012300379", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:29.586468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] validate_networks() for [('c7f79979-914c-42cc-bb29-5a94ac49a40c', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:11:29.966443 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:11:29.966851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:11:29.967353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:11:29.967752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:11:29.968154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:11:29.977176 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:29.977612 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:29.978498 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:29.979026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:29.995199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for project fc9abdfe8063473abfa91f578081eb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:29.999036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Getting quotas for user 39cd1520458f49df9ff4edb63c09f746 and project fc9abdfe8063473abfa91f578081eb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:30.009746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:11:30.012024 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:11:30.058964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7163d97a-1278-464e-9064-815b06c5a0f0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.579828 Jun 18 08:11:30.059679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 289/575] 10.222.0.23 () {62 vars in 1187 bytes} [Sat Jun 18 08:11:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 08:11:30.070668 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:30.071293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:30.073315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:30.127785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:30.135247 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:30.136714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:30.137834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9b3d5250-9dc4-407f-b4cf-a10ce77274ec tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1282 microversion: 2.20 time: 0.071605 Jun 18 08:11:30.138437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 287/576] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:30 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:31.157757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:31.157757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:31.165047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.165481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.166236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.166668 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.230035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:31.241099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:31.242614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:31.243747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae46938e-f21c-470a-b774-aba118cb620f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1342 microversion: 2.20 time: 0.091297 Jun 18 08:11:31.244288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 290/577] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:31 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:31.756757 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:31.757571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:31.764593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.765231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.766005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.766421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.795095 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e43cf1b7-046b-4554-86c4-a817e3cf04a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042454 Jun 18 08:11:31.795917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 288/578] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:31 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:11:31.856283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:31.856869 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:31.863005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.863608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.864367 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.864797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.889400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:31.967910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eadecb19-2abf-41e2-8fb8-638fb9180379 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 204 len: 0 microversion: 2.1 time: 0.115088 Jun 18 08:11:31.969509 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 291/579] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:11:31 2022] DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:11:31.977461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:31.978058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:31.984104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.984543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:31.985303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:31.985726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:32.185525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:32.193380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ff83c8de-8a30-4ecd-a438-1cafab53b94b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1672 microversion: 2.1 time: 0.219597 Jun 18 08:11:32.193840 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 289/580] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:31 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:32.266122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:32.267464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:32.277665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:32.278268 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:32.279524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:32.280186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:32.414789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:32.423599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:32.425276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:32.426411 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-33fe1f70-f7d1-45ab-a063-85c3e0f8afe9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.167202 Jun 18 08:11:32.427072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 292/581] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:32 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:33.210648 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:33.211319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:33.218209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:33.218684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:33.219492 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:33.219897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:33.445466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:33.446092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:33.453543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:33.453987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:33.454749 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:33.455208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:33.595157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:33.604539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:33.608002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:33.609172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-316bf32c-d9c2-4f8a-b97d-031803e48187 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.167701 Jun 18 08:11:33.619639 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 293/582] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:33 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:33.666320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:33.674156 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-24614fae-3d44-4da6-9160-508e3e80adaf tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1672 microversion: 2.1 time: 0.467370 Jun 18 08:11:33.674726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 290/583] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:33 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1672 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:34.627169 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:34.627777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:34.634489 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:34.634933 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:34.635776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:34.636223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:34.691660 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:34.692685 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:34.700512 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:34.700966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:34.701720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:34.702151 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:34.769605 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:34.777480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:34.778952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:34.780078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ecec7674-2945-4b4b-aada-7fecf3d780e6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.156982 Jun 18 08:11:34.780640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 294/584] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:34 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:34.903465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-b8bae8e5-e1e2-4a05-9752-a445aa1faa54 req-70184fce-2c2d-4d01-8df5-80a783ac6cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:34.913338 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b8bae8e5-e1e2-4a05-9752-a445aa1faa54 req-70184fce-2c2d-4d01-8df5-80a783ac6cd2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:34.914129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b8bae8e5-e1e2-4a05-9752-a445aa1faa54 req-70184fce-2c2d-4d01-8df5-80a783ac6cd2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:34.927325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-b8bae8e5-e1e2-4a05-9752-a445aa1faa54 req-70184fce-2c2d-4d01-8df5-80a783ac6cd2 service nova] Creating event network-changed:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:11:34.933300 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-b8bae8e5-e1e2-4a05-9752-a445aa1faa54 req-70184fce-2c2d-4d01-8df5-80a783ac6cd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033683 Jun 18 08:11:34.934272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 295/585] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:35.050675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:35.059333 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0b9a0f54-673c-44ca-b93a-912aad5f2f0e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1672 microversion: 2.1 time: 0.371805 Jun 18 08:11:35.069982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 291/586] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:34 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1672 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:35.270249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:35.270820 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:35.278169 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.281036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.281961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.282426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.309801 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-70c87d38-ddc2-47bf-b6c8-a1ca6c300fd5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/ips" status: 200 len: 151 microversion: 2.1 time: 0.043875 Jun 18 08:11:35.310842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 296/587] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:11:35 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:35.321948 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dac6f8a-fcaf-43b0-a11d-0e6f371c7678"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:35.323336 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:35.330269 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.330740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.331534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.331974 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.419219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/os-volume_attachments HTTP/1.1 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 74 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:35.420856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {"volumeAttachment": {"volumeId": "7dac6f8a-fcaf-43b0-a11d-0e6f371c7678"}} Jun 18 08:11:35.422593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '5f253692-d1ff-49e3-8583-70666337a4cd', 'body': {'volumeAttachment': {'volumeId': '7dac6f8a-fcaf-43b0-a11d-0e6f371c7678'}}} Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:35.423498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:35.424738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 400 to user: Invalid volume: volume 7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 is already attached to instances: b729a844-3a58-4b1a-9d49-bb4aa97773e6 {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3b4e02a2-2971-4310-9990-7550b617e9a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104450 Jun 18 08:11:35.426431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 292/588] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:11:35 2022] POST /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 08:11:35.432274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:35.432739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:35.439499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.439951 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.440706 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.441139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.465937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:35.545809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-55144871-ef42-43d2-a85b-29bf1a46f022 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 204 len: 0 microversion: 2.1 time: 0.115944 Jun 18 08:11:35.550889 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 297/589] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:11:35 2022] DELETE /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:11:35.557252 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:35.557864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:35.564553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.564998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.565766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.566194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.796339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:35.798799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:35.799767 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:35.804626 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-613b2e6d-a9f5-4dd8-ae28-7c5561ddf12a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1682 microversion: 2.1 time: 0.251361 Jun 18 08:11:35.805202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 293/590] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:35 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:35.808050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.808680 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.809747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:35.810664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:35.939581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:35.947806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:35.949286 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:35.950399 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-950d01c5-3cfe-44c8-a072-41e948ab8447 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.156172 Jun 18 08:11:35.951406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 298/591] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:35 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:36.077113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:36.077714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:36.084155 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.084943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.085801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.086109 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.150278 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:36.158038 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1a37eaa4-ea10-4492-8170-82ba422f0999 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1605 microversion: 2.1 time: 0.084845 Jun 18 08:11:36.158710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 294/592] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:36 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:36.823400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:36.824050 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:36.830769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.831239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.831991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.832409 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.953211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-fa1a6ede-c276-4f17-9f5c-57bdb5733136 req-c20761e7-594c-4dd9-a782-56b760951cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15e626c-3e18-47cb-857d-b92aafddfbb4", "name": "network-vif-deleted", "tag": "6775f598-dc03-4fff-a272-ad6c75956058"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:36.962364 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fa1a6ede-c276-4f17-9f5c-57bdb5733136 req-c20761e7-594c-4dd9-a782-56b760951cdb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.962871 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fa1a6ede-c276-4f17-9f5c-57bdb5733136 req-c20761e7-594c-4dd9-a782-56b760951cdb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.964171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:36.972101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-173975a7-1142-44d5-af68-9fddf41cb7be tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1682 microversion: 2.1 time: 0.153681 Jun 18 08:11:36.972683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 299/593] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:36 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:36.975627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-fa1a6ede-c276-4f17-9f5c-57bdb5733136 req-c20761e7-594c-4dd9-a782-56b760951cdb service nova] Creating event network-vif-deleted:6775f598-dc03-4fff-a272-ad6c75956058 for instance e15e626c-3e18-47cb-857d-b92aafddfbb4 on hv-cinder-82634 Jun 18 08:11:36.977086 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:36.977681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:36.980831 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-fa1a6ede-c276-4f17-9f5c-57bdb5733136 req-c20761e7-594c-4dd9-a782-56b760951cdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031313 Jun 18 08:11:36.981792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 295/594] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:36.987521 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.987978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:36.988733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:36.989160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:37.116959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:37.120574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:37.125844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:37.127395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:37.128503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d82dbe7f-ea0f-4f71-b121-052c916c2d9b tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.154901 Jun 18 08:11:37.129067 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 300/595] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:36 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:37.176725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:37.177418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:37.184173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:37.184614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:37.185726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:37.186154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:37.259666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:37.267335 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-43e0a444-3816-42be-9dc5-8c227867e040 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1323 microversion: 2.1 time: 0.094818 Jun 18 08:11:37.267898 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 296/596] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:37 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1323 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:37.994796 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:37.995645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:38.006957 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.007693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.008927 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.009590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.146122 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:38.146733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:38.153538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.154286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.155045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.155672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.156084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:38.164341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2db79c6-7932-40e3-b4b4-dae001fb0cfb tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1682 microversion: 2.1 time: 0.176050 Jun 18 08:11:38.164924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 301/597] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:37 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:38.284879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:38.286610 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:38.287490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:38.293454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:38.293633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.294072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.294830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.294955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:38.295287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.296104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4bb4baab-2904-4e37-8f92-dc52f8f46a5a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.153974 Jun 18 08:11:38.296695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 297/598] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:38 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:38.326068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:38.326496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:38.326948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lazy-loading 'fault' on Instance uuid e15e626c-3e18-47cb-857d-b92aafddfbb4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:38.366316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:38.373877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-03d2c69e-f479-4a99-a075-ef5454577cc0 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 200 len: 1328 microversion: 2.1 time: 0.091968 Jun 18 08:11:38.374450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 302/599] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:38 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:39.182048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:39.182656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:39.190442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.190641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.191485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.191913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.282612 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:39.290901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a358e742-d1d9-4cbc-9042-18f37d76d2f8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1614 microversion: 2.1 time: 0.112848 Jun 18 08:11:39.291916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 298/600] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:39 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:39.316773 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:39.317326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:39.324377 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.324837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.325588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.326009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.392815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:39.393086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:39.399486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.399927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.400936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.401351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.417093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 HTTP/1.1 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:39.418793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:11:39.420370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'e15e626c-3e18-47cb-857d-b92aafddfbb4'} Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:39.421320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:11:39.422879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:39.424319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:39.424319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dfae0ae8-e336-4542-b6dd-b7924e93cd37 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 404 len: 111 microversion: 2.1 time: 0.032190 Jun 18 08:11:39.424750 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 299/601] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:39 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 08:11:39.429588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f9ade4b9-0eff-46a5-9159-ad721efeb5ed tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '.version_select at 0x7f3be4547ee0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:39.451600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f9ade4b9-0eff-46a5-9159-ad721efeb5ed tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931370856" status: 202 len: 0 microversion: 2.1 time: 0.025792 Jun 18 08:11:39.452539 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 300/602] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 08:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931370856 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:11:39.487375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:39.496063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:39.497595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:39.498886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6ba17de3-580e-45e3-abdc-4167912d2ad3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.188045 Jun 18 08:11:39.499852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 303/603] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:39 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:11:39.942175 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-72aab5eb-ceaf-4d0e-879e-fc53fbf3a9a3 req-427ca2c2-a015-4a0a-926a-ecee97212c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f253692-d1ff-49e3-8583-70666337a4cd", "name": "network-vif-deleted", "tag": "b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:39.953102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-72aab5eb-ceaf-4d0e-879e-fc53fbf3a9a3 req-427ca2c2-a015-4a0a-926a-ecee97212c74 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:39.953815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-72aab5eb-ceaf-4d0e-879e-fc53fbf3a9a3 req-427ca2c2-a015-4a0a-926a-ecee97212c74 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:39.967918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-72aab5eb-ceaf-4d0e-879e-fc53fbf3a9a3 req-427ca2c2-a015-4a0a-926a-ecee97212c74 service nova] Creating event network-vif-deleted:b757cb2c-fda4-4d15-b0cd-a2bc0a5eabe5 for instance 5f253692-d1ff-49e3-8583-70666337a4cd on hv-cinder-82634 Jun 18 08:11:39.973669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-72aab5eb-ceaf-4d0e-879e-fc53fbf3a9a3 req-427ca2c2-a015-4a0a-926a-ecee97212c74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Jun 18 08:11:39.974763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 301/604] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:11:40.243651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b6ebc8e3-7a03-4068-b42d-379d50bc4267 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: .version_select at 0x7f3bdf1f4670>, body: {"keypair": {"name": "tempest-keypair-92332512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaXR0uLmft5oPy/7fvHp7f2pJRKZOWFb6ls6vVHuWFpR7hRcQuFVqIkDI7VBcEzvLLmFz9WWx83IpEbyDrduH9yYsqXcNYdEbEjENhxpte/ykbP25KlZXvMv9oU0jGjGQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:40.247859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:40.248512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:40.261123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b6ebc8e3-7a03-4068-b42d-379d50bc4267 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:40.265072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b6ebc8e3-7a03-4068-b42d-379d50bc4267 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for user 4580375d8069479ab2f18025be4d2128 and project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:40.279331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:40.291196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b6ebc8e3-7a03-4068-b42d-379d50bc4267 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051426 Jun 18 08:11:40.291831 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 304/605] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:11:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:40.310599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:40.312533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:40.315086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:40.323123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:40.323815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:40.324860 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:40.325333 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:40.358907 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:40.359368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:40.359821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lazy-loading 'fault' on Instance uuid 5f253692-d1ff-49e3-8583-70666337a4cd {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:40.417535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:40.431253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fd745050-3166-4973-866d-218d05674c7c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 200 len: 1330 microversion: 2.1 time: 0.125802 Jun 18 08:11:40.433668 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 302/606] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:40 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:40.521536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:40.522164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:40.533529 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:40.533987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:40.534923 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:40.535558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:40.714786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:40.723237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:40.724716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:40.725830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5008287b-a75a-4279-92b8-14ffc08da0c3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.212366 Jun 18 08:11:40.726387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 305/607] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:40 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:41.449278 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:41.449829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:41.456559 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:41.457005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:41.457765 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:41.458411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:41.463446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:41.473030 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd HTTP/1.1 Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:41.474677 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:11:41.476212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '5f253692-d1ff-49e3-8583-70666337a4cd'} Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:41.476999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:11:41.478317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:41.479445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:41.479445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d719a0a-a7ea-4fc6-90f0-13ce13d9e788 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 404 len: 111 microversion: 2.1 time: 0.030931 Jun 18 08:11:41.479445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 303/608] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:41 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:11:41.485488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-51c7252a-cecb-4041-aeb1-5803996b3794 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '.version_select at 0x7f3bdf1f4dc0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:41.504880 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-51c7252a-cecb-4041-aeb1-5803996b3794 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17754154" status: 202 len: 0 microversion: 2.1 time: 0.023266 Jun 18 08:11:41.505542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 306/609] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Jun 18 08:11:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17754154 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:11:41.744982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:41.746066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-92873010", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "838e60ac-16d8-4c86-8375-153c589f9f8c"}], "security_groups": [{"name": "tempest-securitygroup--1100794732"}], "key_name": "tempest-keypair-92332512", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:41.747168 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:41.755100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:41.755546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:41.756590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:41.757180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:41.864743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] validate_networks() for [('838e60ac-16d8-4c86-8375-153c589f9f8c', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:11:41.975440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:41.989197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:41.990862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:41.992138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-21594cf5-79a8-4d63-9ae9-0222064dbe4a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.252262 Jun 18 08:11:41.993279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 307/610] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:41 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:42.252411 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:11:42.252825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:11:42.253297 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:11:42.253729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:11:42.254127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:11:42.263162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.263603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.264385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.264809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.265394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:42.265892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:42.272554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.273000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.273755 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.274180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.281389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:42.285262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Getting quotas for user 4580375d8069479ab2f18025be4d2128 and project 273ac76b51f14a4998a14fcfb06009a8. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:42.296915 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:11:42.299203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:11:42.352730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e03cb1f1-0f17-4cff-9739-ee5a21759490 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611711 Jun 18 08:11:42.355114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 304/611] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:11:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:11:42.360179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lazy-loading 'services' on Instance uuid b729a844-3a58-4b1a-9d49-bb4aa97773e6 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:42.363701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94ef9924-ef77-4c9d-8d32-0253fd301750 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:42.364356 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94ef9924-ef77-4c9d-8d32-0253fd301750 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:42.428571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94ef9924-ef77-4c9d-8d32-0253fd301750 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:42.437398 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94ef9924-ef77-4c9d-8d32-0253fd301750 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1234 microversion: 2.1 time: 0.077662 Jun 18 08:11:42.437951 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 305/612] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:42 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:42.450907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0917f5de-c901-48a8-8567-10640b453d9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments/7dac6f8a-fcaf-43b0-a11d-0e6f371c7678" status: 202 len: 0 microversion: 2.1 time: 0.188879 Jun 18 08:11:42.451551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 308/613] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:11:42 2022] DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments/7dac6f8a-fcaf-43b0-a11d-0e6f371c7678 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 08:11:42.460358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:42.461725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:42.468722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.469380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.470389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:42.470912 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:42.501913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-050c8e75-54b7-445f-a63e-3d1b0240e5d5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Jun 18 08:11:42.502485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 306/614] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:42 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:11:43.011228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:43.011825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:43.018530 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.018947 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.019762 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.020185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.161237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:43.170127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:43.171587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:43.172979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6a499e73-3647-41a6-8fb8-5530dd76cfb6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.166615 Jun 18 08:11:43.173545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 309/615] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:43 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:43.233777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-05034796-1039-4f1b-bb4f-7d99a6aed16d req-9bb03183-e154-4885-9ac7-bd49dd25183e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "name": "network-vif-plugged", "status": "completed", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:43.242114 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-05034796-1039-4f1b-bb4f-7d99a6aed16d req-9bb03183-e154-4885-9ac7-bd49dd25183e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.242545 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-05034796-1039-4f1b-bb4f-7d99a6aed16d req-9bb03183-e154-4885-9ac7-bd49dd25183e service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.253815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-05034796-1039-4f1b-bb4f-7d99a6aed16d req-9bb03183-e154-4885-9ac7-bd49dd25183e service nova] Creating event network-vif-plugged:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:11:43.258712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-05034796-1039-4f1b-bb4f-7d99a6aed16d req-9bb03183-e154-4885-9ac7-bd49dd25183e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028616 Jun 18 08:11:43.259410 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 307/616] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:43.459952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:43.460946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:43.471390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.472130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.473415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.474118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.514424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:43.515706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:43.522872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.523344 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.524119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:43.524561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:43.540093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:43.547847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a4886223-5156-4e2d-939a-b96879cf1278 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1286 microversion: 2.1 time: 0.094416 Jun 18 08:11:43.548416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 310/617] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:43 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:43.559466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e94566f3-5b34-4c29-9a6b-b517ed741d13 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049353 Jun 18 08:11:43.560397 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 308/618] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:43 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:44.191806 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:44.192356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:44.198858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.199341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.200104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.200540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.336279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:44.344277 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:44.345757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:44.347000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bee0fb19-58eb-4267-8308-3afd410a102e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.159392 Jun 18 08:11:44.347580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 311/619] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:44 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:44.566912 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:44.567700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:44.571725 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:44.572713 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:44.574850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.575351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.576085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.576738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.578731 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.579202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.579954 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.580373 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.610210 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c7351cf6-eae9-4b61-8599-31b6a25cf640 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042657 Jun 18 08:11:44.615188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 312/620] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:44 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:11:44.672465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:44.672881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:44.679191 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.679632 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.680420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.680845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.716332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:44.808249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9b1c0cb4-a985-4b9e-a035-adb40d873b50 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 204 len: 0 microversion: 2.1 time: 0.139331 Jun 18 08:11:44.810556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 313/621] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:11:44 2022] DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 08:11:44.813379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:44.820128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:44.820907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:44.822513 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-549cfec8-0804-4ef7-86f1-5c1b64c6451b tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.260281 Jun 18 08:11:44.823462 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 309/622] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:44 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:44.827484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.827999 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.828848 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:44.829336 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:44.964532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:44.972185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-840e314f-6556-47a6-a563-b35d8464d1b8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1681 microversion: 2.1 time: 0.156332 Jun 18 08:11:44.972708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 314/623] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:44 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:45.365339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:45.365946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:45.372231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.372895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.373654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.374264 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.486851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-863cff2d-4400-457b-80b5-9729da5179d5 req-7871bff0-8ff6-442f-8639-5a4dd46293fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e53340a-d169-4af3-ac69-237f29936c85", "tag": "438a19f0-250c-40c9-bebf-d7a6d1e44363"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:45.496183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-863cff2d-4400-457b-80b5-9729da5179d5 req-7871bff0-8ff6-442f-8639-5a4dd46293fa service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.496881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-863cff2d-4400-457b-80b5-9729da5179d5 req-7871bff0-8ff6-442f-8639-5a4dd46293fa service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.509535 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-863cff2d-4400-457b-80b5-9729da5179d5 req-7871bff0-8ff6-442f-8639-5a4dd46293fa service nova] Creating event network-changed:438a19f0-250c-40c9-bebf-d7a6d1e44363 for instance 1e53340a-d169-4af3-ac69-237f29936c85 on hv-cinder-82634 Jun 18 08:11:45.514526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-863cff2d-4400-457b-80b5-9729da5179d5 req-7871bff0-8ff6-442f-8639-5a4dd46293fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 Jun 18 08:11:45.515160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 315/624] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:45.563407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:45.571791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:45.573357 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:45.574479 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5d93c84-f530-4d0f-9fd7-d8781ea87c39 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1408 microversion: 2.20 time: 0.213716 Jun 18 08:11:45.575081 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 310/625] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:45 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:45.844837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:45.845776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:45.855688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.856130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.856881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.857307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.989954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:45.990562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:45.997880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.998324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:45.999127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:45.999551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:46.138426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:46.146254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ebb36c54-4359-4088-ade2-66bfd0693f96 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1681 microversion: 2.1 time: 0.160281 Jun 18 08:11:46.146829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 311/626] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:45 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:46.206704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:46.214888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-13740df1-f7f1-4fec-a472-f9e2379f1756 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.377302 Jun 18 08:11:46.215488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 316/627] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:45 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:46.592692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:46.593284 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:46.599800 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:46.600247 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:46.601015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:46.601446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:46.734716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:46.743055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:46.744552 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:46.745817 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2770733f-e438-495a-8be1-296da7a6720d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1599 microversion: 2.20 time: 0.157150 Jun 18 08:11:46.746361 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 312/628] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:11:46 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:11:46.763746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:46.764250 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:46.771079 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:46.771527 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:46.772298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:46.772711 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:46.789260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:46.851453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7681bb19-31f6-479b-b962-b2df38d4ea54 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091571 Jun 18 08:11:46.852134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 317/629] 10.222.0.23 () {60 vars in 1315 bytes} [Sat Jun 18 08:11:46 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:11:47.162920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:47.163549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:47.170445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:47.170970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:47.171825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:47.172320 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:47.232391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:47.233140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:47.239316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:47.239893 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:47.240927 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:47.241872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:47.471411 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:47.479495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a5b156a-1bb6-4d8d-a7be-9adb7b3cbe99 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.251739 Jun 18 08:11:47.480424 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 318/630] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:47 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:47.780905 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:47.789618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3ce9dbad-db29-491a-a256-ad89da001ba4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1681 microversion: 2.1 time: 0.630478 Jun 18 08:11:47.800724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 313/631] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:47 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1681 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:47.908604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e7e0204b-808e-4b15-87cf-a752cdfdf15a req-0d22dfe2-2a8a-42f3-8616-b66eac05ef2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:47.920545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7e0204b-808e-4b15-87cf-a752cdfdf15a req-0d22dfe2-2a8a-42f3-8616-b66eac05ef2c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:47.921688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7e0204b-808e-4b15-87cf-a752cdfdf15a req-0d22dfe2-2a8a-42f3-8616-b66eac05ef2c service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:47.936008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e7e0204b-808e-4b15-87cf-a752cdfdf15a req-0d22dfe2-2a8a-42f3-8616-b66eac05ef2c service nova] Creating event network-changed:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:11:47.941565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e7e0204b-808e-4b15-87cf-a752cdfdf15a req-0d22dfe2-2a8a-42f3-8616-b66eac05ef2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Jun 18 08:11:47.942295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 319/632] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:48.497715 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:48.498356 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:48.505341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:48.505795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:48.506589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:48.506992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:48.808997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:48.810154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:48.816914 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:48.817360 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:48.818318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:48.818744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:48.885495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:48.907895 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-79844f94-0281-4948-bb84-8583cf9f0c4a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1613 microversion: 2.1 time: 0.103082 Jun 18 08:11:48.908486 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 320/633] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:48 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:48.920052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:48.928741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48c028dd-02f2-4b35-8bc4-87c13d0118a7 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.435524 Jun 18 08:11:48.929544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 314/634] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:48 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:49.169219 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-511c66c5-10c1-4b54-b6b2-6c83d42f6450 req-c8a28877-bf37-404e-9476-a1cf186d87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b729a844-3a58-4b1a-9d49-bb4aa97773e6", "name": "network-vif-deleted", "tag": "cc1e7c56-27e8-4f1c-8c35-238d6c80f431"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:49.184213 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-511c66c5-10c1-4b54-b6b2-6c83d42f6450 req-c8a28877-bf37-404e-9476-a1cf186d87e8 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:49.185510 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-511c66c5-10c1-4b54-b6b2-6c83d42f6450 req-c8a28877-bf37-404e-9476-a1cf186d87e8 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:49.197924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-511c66c5-10c1-4b54-b6b2-6c83d42f6450 req-c8a28877-bf37-404e-9476-a1cf186d87e8 service nova] Creating event network-vif-deleted:cc1e7c56-27e8-4f1c-8c35-238d6c80f431 for instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 on hv-cinder-82634 Jun 18 08:11:49.203210 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-511c66c5-10c1-4b54-b6b2-6c83d42f6450 req-c8a28877-bf37-404e-9476-a1cf186d87e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038703 Jun 18 08:11:49.204197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 321/635] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:49.927439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:49.929504 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:49.939726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:49.940376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:49.941367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:49.941805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:49.950872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:49.954789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:49.979666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:49.980463 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:49.981877 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:49.982679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:50.020379 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:50.029325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6e48e1ea-192f-4803-b76f-bdeb7ad389d7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 200 len: 1326 microversion: 2.1 time: 0.107195 Jun 18 08:11:50.031055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 315/636] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:49 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:50.162558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:50.170921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30332b3b-d1d7-4e35-891d-1b85ce6f3fe8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.228138 Jun 18 08:11:50.173779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 322/637] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:49 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:51.047281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:51.047997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:51.054802 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:51.055288 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:51.056042 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:51.056469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:51.070516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 HTTP/1.1 Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:11:51.072183 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:11:51.073792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'b729a844-3a58-4b1a-9d49-bb4aa97773e6'} Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:11:51.078154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:11:51.079577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:11:51.080823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:11:51.080823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-40c766f3-df3c-48f0-b7d5-4885a46ba149 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 404 len: 111 microversion: 2.1 time: 0.030487 Jun 18 08:11:51.080823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 316/638] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:51 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:11:51.081063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:51.085405 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3f46d2f2-7599-4f51-834c-e9d7b2e5bb1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '.version_select at 0x7f3bdf252e50>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:51.107051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3f46d2f2-7599-4f51-834c-e9d7b2e5bb1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531614118" status: 202 len: 0 microversion: 2.1 time: 0.027957 Jun 18 08:11:51.107559 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 323/639] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 08:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531614118 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:11:51.188412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:51.189015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:51.195437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:51.195885 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:51.196655 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:51.197086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:51.333435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:51.342600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25b2e787-e372-40fd-8f3f-182fe7f7c3b4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.158304 Jun 18 08:11:51.343628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 317/640] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:51 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:51.746171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-43d05c4b-e2cf-4d17-9d8a-7d83a3b1061e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: .version_select at 0x7f3bdf1c7310>, body: {"keypair": {"name": "tempest-keypair-1792137633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbWMHeCvfylxmMl8e5Acz1kYculQJEA4neICnoUf2GHoovhecG175vrZcuK8BxY/KCYnb5J5ryiulFrbOjkSz4RnrhJu00JnEWlqhUrhzXHGPK3E63DQFgwZmzjVsfSmQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:51.760781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-43d05c4b-e2cf-4d17-9d8a-7d83a3b1061e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:51.764826 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-43d05c4b-e2cf-4d17-9d8a-7d83a3b1061e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:51.788338 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-43d05c4b-e2cf-4d17-9d8a-7d83a3b1061e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046148 Jun 18 08:11:51.788903 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 324/641] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:11:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:52.359380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:52.359959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:52.362785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:52.368539 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:52.368992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:52.369767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:52.370203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:52.433229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:52.585172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:52.592914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-989e6fb6-b4e1-4a39-96f6-bfe5d762ba6a tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.237500 Jun 18 08:11:52.593458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 318/642] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:52 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:53.133496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1869071739", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626"}], "security_groups": [{"name": "tempest-securitygroup--1157511971"}], "key_name": "tempest-keypair-1792137633", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:53.232934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] validate_networks() for [('bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:11:53.610021 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:53.611031 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:53.618567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:53.619124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:53.620033 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:53.620689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:53.635337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:11:53.635904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:11:53.636542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:11:53.636952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:11:53.637350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:11:53.646691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:53.647163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:53.647950 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:53.648451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:53.669844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:11:53.674093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:11:53.685491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:11:53.687910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:11:53.740832 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-89486129-c1a6-47ff-b202-3c5ba25823e4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.612387 Jun 18 08:11:53.741701 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 325/643] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:11:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:11:53.751603 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7d29000b-8124-4ca2-8c19-8fe3eccfc02c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:53.752204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d29000b-8124-4ca2-8c19-8fe3eccfc02c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:53.818395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7d29000b-8124-4ca2-8c19-8fe3eccfc02c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:53.826382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7d29000b-8124-4ca2-8c19-8fe3eccfc02c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1242 microversion: 2.1 time: 0.078469 Jun 18 08:11:53.832511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 326/644] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:53 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:11:54.018248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:54.025996 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d951deb-5f01-43e3-8381-60ece5473cd6 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.419912 Jun 18 08:11:54.026583 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 319/645] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:53 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:54.843482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:54.844036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:54.850747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:54.851224 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:54.851970 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:54.852399 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:54.915860 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:54.924799 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-29832e51-dd1a-4d75-b3a8-470ed3d4d59f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1312 microversion: 2.1 time: 0.085214 Jun 18 08:11:54.925654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 327/646] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:54 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1312 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:55.045978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:55.046641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:55.056071 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:55.056834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:55.057644 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:55.058075 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:55.238842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3aa0eea0-664b-4bbe-9150-0291d11c0c60 req-e35e41fa-5503-4182-bee7-bdce6983c2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e53340a-d169-4af3-ac69-237f29936c85", "name": "network-vif-plugged", "status": "completed", "tag": "438a19f0-250c-40c9-bebf-d7a6d1e44363"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:55.250517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3aa0eea0-664b-4bbe-9150-0291d11c0c60 req-e35e41fa-5503-4182-bee7-bdce6983c2cb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:55.252511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3aa0eea0-664b-4bbe-9150-0291d11c0c60 req-e35e41fa-5503-4182-bee7-bdce6983c2cb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:55.265098 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3aa0eea0-664b-4bbe-9150-0291d11c0c60 req-e35e41fa-5503-4182-bee7-bdce6983c2cb service nova] Creating event network-vif-plugged:438a19f0-250c-40c9-bebf-d7a6d1e44363 for instance 1e53340a-d169-4af3-ac69-237f29936c85 on hv-cinder-82634 Jun 18 08:11:55.269375 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:55.271576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-3aa0eea0-664b-4bbe-9150-0291d11c0c60 req-e35e41fa-5503-4182-bee7-bdce6983c2cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039608 Jun 18 08:11:55.272083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 328/647] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:55.277640 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06055431-3be3-4fe1-b02b-c4d444356bda tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.237847 Jun 18 08:11:55.285431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 320/648] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:55 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:55.948998 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:55.951215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:55.963943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:55.964352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:55.965353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:55.965970 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:56.098567 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:56.107311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ce14791-e121-4c28-b6aa-d87395514a02 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.166539 Jun 18 08:11:56.108249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 329/649] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:55 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:56.294266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:56.294852 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:56.301429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:56.301886 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:56.302695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:56.303160 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:56.527586 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:56.535639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a96c12c5-aa18-42d8-a7b3-04c2f2ded061 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1360 microversion: 2.1 time: 0.245413 Jun 18 08:11:56.543200 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 321/650] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:56 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:56.654123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-5950db4e-d27b-4f62-a4a7-4d861891b0e0 req-b91b9a55-de11-4a7a-a102-75c104e0b4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0db5b5-f762-45a3-9c16-d43416d4ed1f", "tag": "34d646f8-d1f1-4dda-a910-284ea3e57139"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:56.662139 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5950db4e-d27b-4f62-a4a7-4d861891b0e0 req-b91b9a55-de11-4a7a-a102-75c104e0b4cc service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:56.662688 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5950db4e-d27b-4f62-a4a7-4d861891b0e0 req-b91b9a55-de11-4a7a-a102-75c104e0b4cc service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:56.674331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-5950db4e-d27b-4f62-a4a7-4d861891b0e0 req-b91b9a55-de11-4a7a-a102-75c104e0b4cc service nova] Creating event network-changed:34d646f8-d1f1-4dda-a910-284ea3e57139 for instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f on hv-cinder-82634 Jun 18 08:11:56.679775 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-5950db4e-d27b-4f62-a4a7-4d861891b0e0 req-b91b9a55-de11-4a7a-a102-75c104e0b4cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029087 Jun 18 08:11:56.680393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 330/651] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:57.129636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:57.130627 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:57.142143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.142835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.143650 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.144306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.251210 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:57.251210 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:57.257992 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.258452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.259245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.259769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.317201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:57.325870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fa532db-dc2a-4767-ae4a-b4480350e11e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.203073 Jun 18 08:11:57.326462 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 322/652] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:57 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:57.343764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'services' on Instance uuid 7757ca67-53be-42e1-b461-bbaea10664e6 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:11:57.420177 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f864f9b-cd10-4c7e-99e3-9f71188941b2 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments/04ef5c34-36b7-4e2c-b0e8-8bb0c640302e" status: 202 len: 0 microversion: 2.1 time: 0.173992 Jun 18 08:11:57.421155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 331/653] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:11:57 2022] DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments/04ef5c34-36b7-4e2c-b0e8-8bb0c640302e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 08:11:57.434079 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:57.435879 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:57.442396 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.442899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.443738 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.444218 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.464593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:57.479324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d353bff5-bacf-4663-9755-4229fa55ac44 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052278 Jun 18 08:11:57.480014 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 323/654] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:57 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:57.553439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:57.554144 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:57.560917 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.561390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.562150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.562585 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.693121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:57.701102 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11435afa-845b-4ebd-adb6-c3e39a3dd4b5 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1545 microversion: 2.1 time: 0.152042 Jun 18 08:11:57.701654 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 332/655] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:57 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:57.723204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:57.723694 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:57.729936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.730381 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.731177 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:57.731594 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:57.811072 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1001cffc-8055-418e-92d1-461ed832ed71 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091432 Jun 18 08:11:57.812054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 324/656] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:11:57 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:11:58.344494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:58.345997 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:58.353241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.354181 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.355197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.356097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.492002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:58.492858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:58.495303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:58.503202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.503579 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.504360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.504796 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.543482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5d46959e-f41d-408d-9f22-3aebeb325bdc tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055711 Jun 18 08:11:58.550153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 325/657] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:11:58 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 08:11:58.621107 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:58.621628 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:58.631194 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.631682 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.634219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.634899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.662631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:11:58.750169 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b349ef5-e4ac-404b-ae7c-e4b842b55092 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 204 len: 0 microversion: 2.1 time: 0.135090 Jun 18 08:11:58.750927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 326/658] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:11:58 2022] DELETE /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 08:11:58.759857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:58.760182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:58.766532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.766975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.767947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:58.768363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:58.821964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:58.830031 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-25954305-8680-4868-b3cb-6687687384ca tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.490462 Jun 18 08:11:58.839331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 333/659] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:58 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:11:58.902727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:11:58.910497 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-91687136-0a4c-4c48-aeb4-767eb3d08ec7 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1689 microversion: 2.1 time: 0.155418 Jun 18 08:11:58.911171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 327/660] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:58 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:11:59.087118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-287697d6-85d9-412e-801d-7911fa493853 req-d160f715-e953-45ba-b6b1-df3b457669a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e53340a-d169-4af3-ac69-237f29936c85", "tag": "438a19f0-250c-40c9-bebf-d7a6d1e44363"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:11:59.095304 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-287697d6-85d9-412e-801d-7911fa493853 req-d160f715-e953-45ba-b6b1-df3b457669a5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:59.095732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-287697d6-85d9-412e-801d-7911fa493853 req-d160f715-e953-45ba-b6b1-df3b457669a5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:59.106627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-287697d6-85d9-412e-801d-7911fa493853 req-d160f715-e953-45ba-b6b1-df3b457669a5 service nova] Creating event network-changed:438a19f0-250c-40c9-bebf-d7a6d1e44363 for instance 1e53340a-d169-4af3-ac69-237f29936c85 on hv-cinder-82634 Jun 18 08:11:59.111675 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-287697d6-85d9-412e-801d-7911fa493853 req-d160f715-e953-45ba-b6b1-df3b457669a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028284 Jun 18 08:11:59.112260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 334/661] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:11:59.847392 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:59.848028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:59.855067 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:59.855528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:59.856337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:59.856800 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:59.928773 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:11:59.929471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:11:59.931539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:11:59.937851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:59.938673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:59.939495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:11:59.940062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:11:59.995974 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:00.005266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9a6b9ef4-db6c-4c57-92ad-a25e50e08eb9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.161869 Jun 18 08:12:00.006284 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 328/662] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:59 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:00.265905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:00.274547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2ecadd7-484c-491d-8cd5-23063dd6e888 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1689 microversion: 2.1 time: 0.350194 Jun 18 08:12:00.275397 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 335/663] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:11:59 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1689 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:12:01.025885 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:01.026599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:01.034778 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:01.035341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:01.036242 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:01.036752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:01.169113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:01.176769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-61070c0e-d933-4353-b9a4-a41ecc62244e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.157421 Jun 18 08:12:01.177306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 329/664] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:01 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:01.291400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:01.292008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:01.299455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:01.299892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:01.300660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:01.301081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:01.430623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:01.445161 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7bb9a23f-cd33-42bf-a022-87d592d3bbd6 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1689 microversion: 2.1 time: 0.157105 Jun 18 08:12:01.446483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 336/665] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:01 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:02.200058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:02.200787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:02.209155 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:02.209719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:02.210931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:02.211284 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:02.349953 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:02.357600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb64b725-6f4a-4f9a-9a3c-c5f774cf4ae0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.165259 Jun 18 08:12:02.358212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 330/666] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:02 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:02.472206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:02.473186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:02.484199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:02.484994 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:02.486221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:02.486920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:02.621924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:02.629507 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ce204749-495e-4a13-8bfb-3a6f0f003bf5 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1689 microversion: 2.1 time: 0.163934 Jun 18 08:12:02.630078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 337/667] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:02 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:03.299485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-3fbb5b39-fe91-45e0-a168-cb722c037622 req-b5c9de89-bb91-4ace-b86b-8234a191da52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0db5b5-f762-45a3-9c16-d43416d4ed1f", "name": "network-vif-plugged", "status": "completed", "tag": "34d646f8-d1f1-4dda-a910-284ea3e57139"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:03.309914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3fbb5b39-fe91-45e0-a168-cb722c037622 req-b5c9de89-bb91-4ace-b86b-8234a191da52 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:03.310480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3fbb5b39-fe91-45e0-a168-cb722c037622 req-b5c9de89-bb91-4ace-b86b-8234a191da52 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:03.322170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-3fbb5b39-fe91-45e0-a168-cb722c037622 req-b5c9de89-bb91-4ace-b86b-8234a191da52 service nova] Creating event network-vif-plugged:34d646f8-d1f1-4dda-a910-284ea3e57139 for instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f on hv-cinder-82634 Jun 18 08:12:03.327260 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-3fbb5b39-fe91-45e0-a168-cb722c037622 req-b5c9de89-bb91-4ace-b86b-8234a191da52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031450 Jun 18 08:12:03.327863 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 331/668] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:03.374007 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:03.374601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:03.381034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:03.381470 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:03.382216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:03.382662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:03.518344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:03.526308 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31faf25e-c73f-4a03-a235-6ddd258bd854 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.156240 Jun 18 08:12:03.527055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 338/669] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:03 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:12:03.652262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:03.652958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:03.660233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:03.661019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:03.662374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:03.663189 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:04.448891 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:04.456867 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-95fdf557-aed3-4465-9456-e795c2b98aa0 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1689 microversion: 2.1 time: 0.808880 Jun 18 08:12:04.457558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 332/670] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:03 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1689 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:04.543211 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:04.543819 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:04.545721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:04.546367 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=12 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:04.552945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:04.553334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:04.554096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:04.554516 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:04.685283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:04.692976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c615244-5fc2-4c5c-ae7a-36cfc303694e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.153814 Jun 18 08:12:04.693536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 339/671] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:04 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:05.062106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-d689b4ec-b5db-44ac-b669-7b4c6cf78212 req-5a6b5e37-d102-46e8-8f6c-cc0e80711bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7757ca67-53be-42e1-b461-bbaea10664e6", "name": "network-vif-deleted", "tag": "978d215d-cdc7-42b9-81c9-3a488c68a236"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:05.070509 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d689b4ec-b5db-44ac-b669-7b4c6cf78212 req-5a6b5e37-d102-46e8-8f6c-cc0e80711bea service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.070963 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d689b4ec-b5db-44ac-b669-7b4c6cf78212 req-5a6b5e37-d102-46e8-8f6c-cc0e80711bea service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.082820 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-d689b4ec-b5db-44ac-b669-7b4c6cf78212 req-5a6b5e37-d102-46e8-8f6c-cc0e80711bea service nova] Creating event network-vif-deleted:978d215d-cdc7-42b9-81c9-3a488c68a236 for instance 7757ca67-53be-42e1-b461-bbaea10664e6 on hv-cinder-82634 Jun 18 08:12:05.087740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-d689b4ec-b5db-44ac-b669-7b4c6cf78212 req-5a6b5e37-d102-46e8-8f6c-cc0e80711bea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029954 Jun 18 08:12:05.088321 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 333/672] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:05.475310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:05.476279 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:05.482857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.483594 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.484549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.485152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.519698 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.520044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.520533 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'fault' on Instance uuid 7757ca67-53be-42e1-b461-bbaea10664e6 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:12:05.523216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:05.563220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:05.571203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fcfa32d2-e940-4a50-aa9f-546a91cab9d8 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 200 len: 1335 microversion: 2.1 time: 0.100855 Jun 18 08:12:05.571795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 340/673] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:05 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:05.711400 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:05.712086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:05.719148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.719588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.720344 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:05.720768 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:05.853730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:05.861274 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-659deb74-eb0c-49c2-95b1-0e293ea4dd33 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1368 microversion: 2.1 time: 0.155038 Jun 18 08:12:05.861775 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 334/674] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:05 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:06.589302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:06.589936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 7757ca67-53be-42e1-b461-bbaea10664e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:06.596843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:06.597287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:06.598043 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:06.598474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:06.612852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] HTTP exception thrown: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Request method failure captured: Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 HTTP/1.1 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYen-2sGjB4XSmK77OS9Uj6OBn3ySfH8juXZ-HV2P_kSMz_IN71w4LPGiZ17uk2sONdCnqZ8BNIszDzBmJyvg7sCBPtVifUTezq51ZvE524S0zFh40PZTubZYw1ykx_eqYWh_Hdr_msQ_KfGwxptBAdOJQKRHRoaMAupxnE4YmhB9DY Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:12:06.614515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bc66714da4345ddb2639465d29fcae0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 62c79651096b4ac3a7414e70c8bdcd7e Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. Jun 18 08:12:06.616059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '7757ca67-53be-42e1-b461-bbaea10664e6'} Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:12:06.616986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. Jun 18 08:12:06.618471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:12:06.619782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Returning 404 to user: Instance 7757ca67-53be-42e1-b461-bbaea10664e6 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:12:06.619782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0b0dab09-c370-413d-82d9-cf81ccb22968 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6" status: 404 len: 111 microversion: 2.1 time: 0.030863 Jun 18 08:12:06.619782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 341/675] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:06 2022] GET /compute/v2.1/servers/7757ca67-53be-42e1-b461-bbaea10664e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:12:06.627661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4339267f-edde-4cd1-a450-22153ec19f96 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '.version_select at 0x7f3be4200790>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:06.649113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4339267f-edde-4cd1-a450-22153ec19f96 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809745430" status: 202 len: 0 microversion: 2.1 time: 0.027864 Jun 18 08:12:06.649652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 335/676] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 08:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809745430 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:12:06.878273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:06.878871 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:06.885343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:06.885787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:06.886592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:06.887044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:07.016597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:07.024398 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f38d026f-6c67-4f23-81b6-af3bfd57364a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1558 microversion: 2.1 time: 0.150077 Jun 18 08:12:07.025040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 342/677] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:06 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:07.040807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:07.041358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:07.048277 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:07.048652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:07.049426 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:07.049865 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:07.143349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fe2ef724-2418-418e-83de-2b51061c21c4 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106455 Jun 18 08:12:07.144093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 336/678] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:12:07 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:12:08.202854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d7c1a571-d027-46a5-8a21-ba320e9d4e30 req-cbed3f39-4233-4866-b136-b35ad46ad69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0db5b5-f762-45a3-9c16-d43416d4ed1f", "tag": "34d646f8-d1f1-4dda-a910-284ea3e57139"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:08.211502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d7c1a571-d027-46a5-8a21-ba320e9d4e30 req-cbed3f39-4233-4866-b136-b35ad46ad69a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:08.211931 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d7c1a571-d027-46a5-8a21-ba320e9d4e30 req-cbed3f39-4233-4866-b136-b35ad46ad69a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:08.222955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d7c1a571-d027-46a5-8a21-ba320e9d4e30 req-cbed3f39-4233-4866-b136-b35ad46ad69a service nova] Creating event network-changed:34d646f8-d1f1-4dda-a910-284ea3e57139 for instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f on hv-cinder-82634 Jun 18 08:12:08.228457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d7c1a571-d027-46a5-8a21-ba320e9d4e30 req-cbed3f39-4233-4866-b136-b35ad46ad69a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029286 Jun 18 08:12:08.229125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 343/679] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:09.743920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:09.744439 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:09.750908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:09.751403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:09.752168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:09.752600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:09.777535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:12:09.854181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f7b866ae-10b8-463b-93db-91cde80517aa tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 204 len: 0 microversion: 2.1 time: 0.114510 Jun 18 08:12:09.854676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 337/680] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:12:09 2022] DELETE /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:12:09.864011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:09.864699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:09.871090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:09.871535 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:09.872284 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:09.872826 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:10.010636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:10.018658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3ae67147-423c-40f1-bea4-0da45f051b8b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1506 microversion: 2.1 time: 0.159400 Jun 18 08:12:10.019241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 344/681] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:09 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:11.039006 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:11.040001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:11.047618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:11.048115 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:11.048866 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:11.049291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:11.192721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:11.200832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bef689fe-fabd-4b85-8d8d-002722aacdeb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1506 microversion: 2.1 time: 0.168110 Jun 18 08:12:11.201368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 338/682] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:11 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:12.221394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:12.222330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:12.233281 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:12.234004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:12.235287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:12.235986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:12.374744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:12.382389 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cca22111-2e47-4af4-ba03-238d3ebe278a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1506 microversion: 2.1 time: 0.167626 Jun 18 08:12:12.382929 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 345/683] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:12 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:13.094751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-911487fc-ca41-409c-8850-47b21fa1cb01 req-d4c39dff-35e7-451d-af81-79977eff92d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b", "name": "network-vif-deleted", "tag": "46fd2c16-c347-4bbd-87a9-0228ef945bff"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:13.104456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-911487fc-ca41-409c-8850-47b21fa1cb01 req-d4c39dff-35e7-451d-af81-79977eff92d6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:13.104843 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-911487fc-ca41-409c-8850-47b21fa1cb01 req-d4c39dff-35e7-451d-af81-79977eff92d6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:13.117334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-911487fc-ca41-409c-8850-47b21fa1cb01 req-d4c39dff-35e7-451d-af81-79977eff92d6 service nova] Creating event network-vif-deleted:46fd2c16-c347-4bbd-87a9-0228ef945bff for instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b on hv-cinder-82634 Jun 18 08:12:13.123922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-911487fc-ca41-409c-8850-47b21fa1cb01 req-d4c39dff-35e7-451d-af81-79977eff92d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031965 Jun 18 08:12:13.124933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 339/684] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:13.399387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:13.399981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:13.407326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:13.407825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:13.408702 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:13.409203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:13.447490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:13.448167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:13.448615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'fault' on Instance uuid cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:12:13.493386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:13.501424 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5c1d51e-96d7-4194-9515-891d7baff46f tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 200 len: 1311 microversion: 2.1 time: 0.105831 Jun 18 08:12:13.501818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 346/685] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:13 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:14.523571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:14.524720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:14.532814 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.533367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.534266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.534808 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.550758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] HTTP exception thrown: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Request method failure captured: Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b HTTP/1.1 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYen-2sGjB4XSmK77OS9Uj6OBn3ySfH8juXZ-HV2P_kSMz_IN71w4LPGiZ17uk2sONdCnqZ8BNIszDzBmJyvg7sCBPtVifUTezq51ZvE524S0zFh40PZTubZYw1ykx_eqYWh_Hdr_msQ_KfGwxptBAdOJQKRHRoaMAupxnE4YmhB9DY Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:12:14.552730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bc66714da4345ddb2639465d29fcae0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 62c79651096b4ac3a7414e70c8bdcd7e Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. Jun 18 08:12:14.554486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b'} Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:12:14.555391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. Jun 18 08:12:14.557099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:14.558520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Returning 404 to user: Instance cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:12:14.558520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d0cebe6-18b9-4ca8-bedb-40a2be418d30 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b" status: 404 len: 111 microversion: 2.1 time: 0.037960 Jun 18 08:12:14.558520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 340/686] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:14 2022] GET /compute/v2.1/servers/cfdea9b4-e6c4-4e2c-ab04-42afb0089a6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:12:14.564049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:14.564546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:14.571255 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.571704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.572461 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.572886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.597414 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:12:14.676930 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-96401cda-1718-4869-8a63-313650059749 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 204 len: 0 microversion: 2.1 time: 0.116487 Jun 18 08:12:14.677699 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 347/687] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:12:14 2022] DELETE /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:12:14.686165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:14.686765 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:14.693064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.693511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.694262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:14.694692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:14.698700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:14.831403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:14.838926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-305f8ed9-7c5b-458c-88c9-9dce23d58c7a tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.157152 Jun 18 08:12:14.839551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 341/688] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:14 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:15.859554 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:15.860416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:15.869920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:15.870558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:15.871682 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:15.872289 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:16.009209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:16.016904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-324cefaf-9fa8-4834-8472-71dc8f353b28 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.163711 Jun 18 08:12:16.017479 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 348/689] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:15 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:17.037166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:17.038148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:17.045978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:17.046417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:17.047210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:17.047641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:17.186076 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:17.194084 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-acf31d3b-7715-4ccf-a8e7-62fd7feb6fdb tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.163435 Jun 18 08:12:17.194788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 342/690] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:17 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:18.211549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:18.212209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:18.219369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:18.219807 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:18.220561 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:18.220984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:18.352122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:18.363797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2b92e38c-ebe1-4dd3-a8ff-4f23162aef2e tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1520 microversion: 2.1 time: 0.155774 Jun 18 08:12:18.364562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 349/691] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:18 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:19.273787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-282c1dd1-d045-4c03-868d-664e947ab5bf req-e01d9f9b-53eb-44cc-b157-a1451e01739a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f43c1dc-385b-4a5e-8e43-7f7a359df2fb", "name": "network-vif-deleted", "tag": "93d9df61-4cf9-4600-9e37-ac0d1bc0e72e"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:19.282562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-282c1dd1-d045-4c03-868d-664e947ab5bf req-e01d9f9b-53eb-44cc-b157-a1451e01739a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:19.283040 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-282c1dd1-d045-4c03-868d-664e947ab5bf req-e01d9f9b-53eb-44cc-b157-a1451e01739a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:19.294159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-282c1dd1-d045-4c03-868d-664e947ab5bf req-e01d9f9b-53eb-44cc-b157-a1451e01739a service nova] Creating event network-vif-deleted:93d9df61-4cf9-4600-9e37-ac0d1bc0e72e for instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb on hv-cinder-82634 Jun 18 08:12:19.298900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-282c1dd1-d045-4c03-868d-664e947ab5bf req-e01d9f9b-53eb-44cc-b157-a1451e01739a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028847 Jun 18 08:12:19.299532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 343/692] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:19.382091 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:19.382716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:19.389465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:19.389905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:19.390693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:19.391266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:19.422423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:19.422864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:19.423345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lazy-loading 'fault' on Instance uuid 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:12:19.469101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c79651096b4ac3a7414e70c8bdcd7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc66714da4345ddb2639465d29fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:19.476759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d650fb3b-1317-4397-b61c-db3792b0e892 tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 200 len: 1311 microversion: 2.1 time: 0.098528 Jun 18 08:12:19.477306 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 350/693] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:19 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:20.499658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:20.500833 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] [instance: 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:20.511801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:20.512549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:20.513860 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:20.514580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:20.532102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] HTTP exception thrown: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Request method failure captured: Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb HTTP/1.1 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYen-2sGjB4XSmK77OS9Uj6OBn3ySfH8juXZ-HV2P_kSMz_IN71w4LPGiZ17uk2sONdCnqZ8BNIszDzBmJyvg7sCBPtVifUTezq51ZvE524S0zFh40PZTubZYw1ykx_eqYWh_Hdr_msQ_KfGwxptBAdOJQKRHRoaMAupxnE4YmhB9DY Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:12:20.533699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6bc66714da4345ddb2639465d29fcae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6bc66714da4345ddb2639465d29fcae0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 6bc66714da4345ddb2639465d29fcae0 Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1361096697 Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 62c79651096b4ac3a7414e70c8bdcd7e Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1361096697-project Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. Jun 18 08:12:20.535098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '2f43c1dc-385b-4a5e-8e43-7f7a359df2fb'} Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:12:20.535864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. Jun 18 08:12:20.537213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:12:20.538331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] Returning 404 to user: Instance 2f43c1dc-385b-4a5e-8e43-7f7a359df2fb could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:12:20.538331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48af761d-a7db-4407-9da0-ba3e4750701b tempest-ServerRescueNegativeTestJSON-1361096697 tempest-ServerRescueNegativeTestJSON-1361096697-project] 10.222.0.23 "GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb" status: 404 len: 111 microversion: 2.1 time: 0.043433 Jun 18 08:12:20.538331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 344/694] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:20 2022] GET /compute/v2.1/servers/2f43c1dc-385b-4a5e-8e43-7f7a359df2fb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:12:26.145377 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1496f0e9-8625-48cc-9967-152f355e8d50 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf2d3430>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:26.195394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1496f0e9-8625-48cc-9967-152f355e8d50 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/354a399e-2f38-463a-a729-6e283451672c" status: 200 len: 351 microversion: 2.1 time: 0.053790 Jun 18 08:12:26.195962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 351/695] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:12:26 2022] GET /compute/v2.1/os-volumes/354a399e-2f38-463a-a729-6e283451672c => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:27.549272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f580e816-84cc-46f6-9068-8fe69f2a6c2a tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3be424f820>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:27.600761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f580e816-84cc-46f6-9068-8fe69f2a6c2a tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/eb12cb1b-a91a-43bc-b44f-5286a176b20d" status: 200 len: 351 microversion: 2.1 time: 0.055343 Jun 18 08:12:27.601337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 345/696] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:12:27 2022] GET /compute/v2.1/os-volumes/eb12cb1b-a91a-43bc-b44f-5286a176b20d => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:28.960055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30e530f1-823c-469d-ab4d-ee3268eceab1 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf15da60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.007129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30e530f1-823c-469d-ab4d-ee3268eceab1 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/08ad64ed-b511-43e5-b552-5b4feff099ce" status: 200 len: 351 microversion: 2.1 time: 0.051338 Jun 18 08:12:29.007719 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 352/697] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:12:28 2022] GET /compute/v2.1/os-volumes/08ad64ed-b511-43e5-b552-5b4feff099ce => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:29.019295 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56f39d2d-c80c-4170-a4dd-2683936b9e2e tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3be41e38b0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.101266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-56f39d2d-c80c-4170-a4dd-2683936b9e2e tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086192 Jun 18 08:12:29.101834 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 346/698] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:29.114508 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-59fd08d9-f0bf-4813-9e02-63f90de39c02 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf111040>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.195421 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-59fd08d9-f0bf-4813-9e02-63f90de39c02 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084678 Jun 18 08:12:29.196026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 353/699] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:29.212372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7ea89450-0447-4a79-969b-bf32591d5734 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3be420caf0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.294706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7ea89450-0447-4a79-969b-bf32591d5734 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087627 Jun 18 08:12:29.295500 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 347/700] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:29.313133 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ddf243f6-30d5-4a9b-a2b4-a5d5f9e5c26d tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf111160>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.397544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ddf243f6-30d5-4a9b-a2b4-a5d5f9e5c26d tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090507 Jun 18 08:12:29.398287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 354/701] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:29.411602 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9a80b4b8-01fc-4b6e-84e8-f27d779f3613 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3be41a6670>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.494908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9a80b4b8-01fc-4b6e-84e8-f27d779f3613 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088346 Jun 18 08:12:29.495530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 348/702] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:29.505543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:29.506413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:29.511466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-612d4eb5-d210-4dde-9d4b-aac908fa0a61 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf1c7160>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.594081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-612d4eb5-d210-4dde-9d4b-aac908fa0a61 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089906 Jun 18 08:12:29.594655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 355/703] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:29.606053 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a13deae0-f496-4793-971d-86143efeeb5a tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3be41773a0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.692136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a13deae0-f496-4793-971d-86143efeeb5a tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089752 Jun 18 08:12:29.693045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 349/704] 10.222.0.23 () {58 vars in 1187 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:29.708669 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a43cb0d-3b92-4267-a771-16745897e8e7 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] Calling method '.version_select at 0x7f3bdf105310>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:29.800938 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a43cb0d-3b92-4267-a771-16745897e8e7 tempest-VolumesTestJSON-206518833 tempest-VolumesTestJSON-206518833-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.098126 Jun 18 08:12:29.801844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 356/705] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Jun 18 08:12:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:31.432733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:31.433868 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=14 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:31.605151 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:31.605643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:31.612086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:31.612531 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:31.613290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:31.613720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:31.638448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f5959fc6-9a03-412e-87df-7fea70ce4344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/ips" status: 200 len: 151 microversion: 2.20 time: 0.206994 Jun 18 08:12:31.638993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 350/706] 10.222.0.23 () {60 vars in 1288 bytes} [Sat Jun 18 08:12:31 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/ips => generated 151 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:12:33.446319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:33.446878 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:33.453065 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:33.453511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:33.454277 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:33.454705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:33.480029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lazy-loading 'flavor' on Instance uuid bd41f096-17fd-4698-b185-6ff22ddb8826 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:12:33.741693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-97d162e1-544a-4ec4-bbd7-a10ec38a02db tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/action" status: 202 len: 0 microversion: 2.20 time: 0.299617 Jun 18 08:12:33.742748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 357/707] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 08:12:33 2022] POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:12:33.751474 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:33.752182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:33.762253 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:33.762690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:33.763581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:33.764021 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:33.902725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:33.923538 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:33.925483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:33.926891 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35b24540-4196-4e89-aa7e-893e4d1b907a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.179885 Jun 18 08:12:33.927641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 351/708] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:33 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:34.947046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:34.947757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:34.954432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:34.954852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:34.955619 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:34.956217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:35.096161 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:35.104330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:35.105834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:35.106995 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-db6d089c-e143-42de-9b73-36f010955cc8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.165025 Jun 18 08:12:35.107628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 358/709] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:34 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:36.126835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:36.127680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:36.135319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:36.135786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:36.136552 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:36.136983 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:36.271293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:36.283318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:36.285308 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:36.286993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2eb1b456-bb8a-4a79-90ad-d1d9f98505cb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.164807 Jun 18 08:12:36.287787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 352/710] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:36 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:37.309142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:37.309818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:37.317082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:37.317665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:37.318561 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:37.319058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:37.449478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:37.457416 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:37.458899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:37.460081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e29958db-012a-4628-a9cd-c9f574980c2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.156845 Jun 18 08:12:37.460621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 359/711] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:37 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:38.481499 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:38.482097 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:38.489080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:38.489526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:38.490304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:38.490730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:38.625199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:38.637475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:38.638995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:38.640171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d493a425-841f-4528-8194-c9401b0d95c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.164975 Jun 18 08:12:38.640732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 353/712] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:38 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:39.664988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:39.666001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:39.676976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:39.677717 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:39.678960 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:39.679713 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:39.829438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:39.837919 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:39.839438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:39.840657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c6a2ac38-009e-420c-9ac0-747d2aecf77f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.182274 Jun 18 08:12:39.841227 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 360/713] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:39 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:40.860175 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:40.860763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:40.867408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:40.867886 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:40.868669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:40.869077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:40.997679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:41.008593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:41.010914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:41.012709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8cd023fa-0415-4e5a-8670-2a5a62817250 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.156360 Jun 18 08:12:41.013546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 354/714] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:40 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:42.036241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:42.037185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:42.048323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:42.049028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:42.050301 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:42.051056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:42.184561 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:42.192577 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:42.194096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:42.195287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cba3743e-9bab-4a82-9089-8e09461be0ab tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.166417 Jun 18 08:12:42.195861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 361/715] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:42 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:42.931762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:42.932372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:42.939442 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:42.939892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:42.940672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:42.941108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:42.971606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-56689a65-ce94-4295-83d7-980f35e94457 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/ips" status: 200 len: 144 microversion: 2.1 time: 0.221756 Jun 18 08:12:42.972518 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 355/716] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:12:42 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/ips => generated 144 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:43.213667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:43.214258 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:43.222497 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:43.223165 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:43.224289 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:43.225227 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:43.375382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:43.383552 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:43.385080 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:43.386275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f4d61c3e-bfd4-4a5e-9051-2f73fad9fac8 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.176503 Jun 18 08:12:43.386851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 362/717] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:43 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:44.324086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02ff7cb3-45b8-4ebe-93d7-709e48521cce"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:44.325209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:44.332283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:44.332733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:44.333575 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:44.334011 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:44.409640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:44.410242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:44.417152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:44.417596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:44.418625 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:44.419106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:44.561540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:44.569797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:44.571575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:44.572864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2facdf59-08e7-4699-8764-172e95f8fb2e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.167234 Jun 18 08:12:44.573502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 363/718] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:44 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:12:44.645598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-249d0bee-43f3-47b3-a73c-711dbd77a5dd tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326056 Jun 18 08:12:44.646224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 356/719] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:12:44 2022] POST /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:45.591750 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:45.592353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:45.598881 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:45.599347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:45.600105 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:45.600526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:45.735816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:45.745737 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:45.747723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:45.748932 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-97b36922-e699-4065-8ae4-9f2080b7b874 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.161259 Jun 18 08:12:45.749511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 364/720] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:45 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:46.767548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:46.768261 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:46.774974 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:46.775454 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:46.776205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:46.776626 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:46.910729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:46.919277 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:46.920845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:46.922056 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3b6867a9-6164-45cc-b477-1c60b6098ae3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.158829 Jun 18 08:12:46.926838 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 357/721] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:46 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:47.941412 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:47.941965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:47.949062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:47.949507 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:47.950256 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:47.950677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:48.085632 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:48.097773 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:48.100266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:48.101955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-76bf962f-1608-426e-ac97-9f3db67c601d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.164204 Jun 18 08:12:48.102746 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 365/722] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:47 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:49.126169 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:49.127210 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:49.138195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:49.138805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:49.139613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:49.140044 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:49.275861 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:49.284721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:49.286215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:49.287493 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7344e945-923f-4bfb-be73-d6894b45f0a5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.168140 Jun 18 08:12:49.288058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 358/723] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:49 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:50.306196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:50.306822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:50.314078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:50.314549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:50.315341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:50.315725 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:50.453307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:50.462318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:50.463941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:50.465144 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b6bcccee-21bb-452b-97df-681b76bdb18d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1745 microversion: 2.20 time: 0.163189 Jun 18 08:12:50.466136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 366/724] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:50 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:51.485428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:51.486148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:51.493066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:51.493886 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:51.494730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:51.495367 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:51.725741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:51.736527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:51.741049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:51.744645 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-66f9452e-77a2-4a29-a8b8-4c7657a65921 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1745 microversion: 2.20 time: 0.263896 Jun 18 08:12:51.746199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 359/725] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:51 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1745 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:51.920381 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:51.921471 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:51.928294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:51.929134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:51.930035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:51.930943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:51.955923 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c3f5be7a-ae5e-4512-a662-5f6c599e4650 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040477 Jun 18 08:12:51.956650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 367/726] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:12:51 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:52.255805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:52.256981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:52.264206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.264648 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.265824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.266416 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.304909 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2ee668b7-6f9e-4201-b8c0-0b922541438f tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054337 Jun 18 08:12:52.305816 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 360/727] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:12:52 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:52.319195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:52.319772 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:52.326980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.328005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.328776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.329747 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.369836 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1a6a427-fbe0-4c1b-8cee-52fc2f11e5a9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce" status: 200 len: 194 microversion: 2.1 time: 0.057775 Jun 18 08:12:52.371571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 368/728] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 08:12:52 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:12:52.765416 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:52.766048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:52.773605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.774051 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.775028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:52.775606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:52.956165 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:52.966881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:52.971637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:52.972972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7193acab-7111-499f-9d11-bd7493f59ed6 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.212743 Jun 18 08:12:52.978209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 361/729] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:52 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:53.425062 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea91429b-c5ba-4987-90fb-eed6e5a5c150"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:53.426974 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:53.443223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:53.443955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:53.444918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:53.445500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:53.902452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-851c15aa-0735-4533-802b-24c4caadb1de tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481661 Jun 18 08:12:53.904407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e3fe3d7c-b135-4089-98b4-a0d17020a31b req-02f88e05-de3c-4826-a0f7-bfd40e389439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "name": "network-vif-plugged", "status": "completed", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:53.910311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 369/730] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:12:53 2022] POST /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:53.917608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b021f2b-3ed0-403f-8a3b-d883999011ce"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:53.919313 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:53.927390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:53.928128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:53.929214 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:53.929899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:53.943158 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e3fe3d7c-b135-4089-98b4-a0d17020a31b req-02f88e05-de3c-4826-a0f7-bfd40e389439 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:53.944059 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e3fe3d7c-b135-4089-98b4-a0d17020a31b req-02f88e05-de3c-4826-a0f7-bfd40e389439 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:53.961083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:53.968917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e3fe3d7c-b135-4089-98b4-a0d17020a31b req-02f88e05-de3c-4826-a0f7-bfd40e389439 service nova] Creating event network-vif-plugged:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:12:53.999542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e3fe3d7c-b135-4089-98b4-a0d17020a31b req-02f88e05-de3c-4826-a0f7-bfd40e389439 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355282 Jun 18 08:12:54.003580 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 362/731] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:54.013544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:54.014244 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:54.052698 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:54.062773 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:54.067358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:54.067967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:54.256137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:54.269976 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:54.272188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:54.276466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d6c9a74d-4b9b-44d7-b8d8-98a371239783 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.268848 Jun 18 08:12:54.277528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 363/732] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:54 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:54.426588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93f01235-a85c-4339-8480-84017b66389e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "POST /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514338 Jun 18 08:12:54.427858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 370/733] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:12:53 2022] POST /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:12:55.300496 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:55.301826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:55.312679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:55.313672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:55.316913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:55.316913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:55.491366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:55.499874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:55.501380 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:55.502581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0e56fc19-2b73-4003-be6c-e8ec7d41b846 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.210988 Jun 18 08:12:55.503172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 364/734] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:55 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:56.523595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:56.524331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:56.531146 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:56.531558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:56.532943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:56.533811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:56.710553 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:56.719071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:56.721196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:56.722817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c7845d8d-e457-48ff-a1c3-7f41d677c290 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.205895 Jun 18 08:12:56.733239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 371/735] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:56 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:56.752911 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1908729840", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:12:56.805582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] validate_networks() for None {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:12:57.370979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:12:57.371862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:12:57.372481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:12:57.373060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:12:57.373461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:12:57.383924 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:57.384641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:57.385637 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:57.386066 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:57.403313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Getting quotas for project b851c318437948ff89683420f078ebb8. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:12:57.407605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Getting quotas for user 0aeb9b06d72f43abae981722be3bfbb9 and project b851c318437948ff89683420f078ebb8. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:12:57.421624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:12:57.424186 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:12:57.472282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3753be02-a207-4758-a586-721b81b02beb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723000 Jun 18 08:12:57.473203 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 365/736] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:12:57.483598 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f0e62129-126e-4b88-95b5-e82b978873a7 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:57.484496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f0e62129-126e-4b88-95b5-e82b978873a7 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:57.568343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f0e62129-126e-4b88-95b5-e82b978873a7 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:57.576318 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f0e62129-126e-4b88-95b5-e82b978873a7 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1215 microversion: 2.1 time: 0.096620 Jun 18 08:12:57.586327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 372/737] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:57 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:57.741388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:57.742522 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:57.754768 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:57.756231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:57.757726 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:57.758535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:57.971537 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:57.984890 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:57.986498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:57.988003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51138ee1-858e-4779-bdb4-aa0a388d3922 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.250869 Jun 18 08:12:57.999052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 366/738] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:57 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:58.592883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:58.593486 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:58.601537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:58.601980 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:58.602748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:58.603214 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:58.667286 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:58.675344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e29fb25c-2d8f-4d7b-8e58-6aad81738ebb tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1267 microversion: 2.1 time: 0.086298 Jun 18 08:12:58.677905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 373/739] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:58 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:12:59.006793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:59.008058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:59.016768 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:59.018096 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:59.019070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:59.020326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:59.025179 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:59.206898 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:59.216752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:59.218868 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:59.220673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aab65ad5-a5f8-4e62-9468-376c76d6d7bb tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.217757 Jun 18 08:12:59.232144 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 367/740] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:12:59 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:12:59.696730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:12:59.698623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:12:59.713115 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=37 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:12:59.720011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:59.721090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:59.723798 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:12:59.730620 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:12:59.943457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:12:59.954145 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05def5e1-0f6e-4ee9-81f2-3342ef83e10c tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.262739 Jun 18 08:12:59.955374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 374/741] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:12:59 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:00.240956 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:00.242157 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:00.266921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:00.267680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:00.268946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:00.269543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:00.572133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:00.585201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:00.586992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:00.588521 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-201e39f3-c69d-4d95-a584-404e31739e2a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.351890 Jun 18 08:13:00.589599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 368/742] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:00 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:13:00.974576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:00.975323 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:00.989730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:00.990223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:00.992019 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:00.993697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.191403 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:01.201381 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82765619-9a02-47e2-b832-a6eba180dcd0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.232044 Jun 18 08:13:01.211342 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 375/743] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:00 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:01.595692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2a1a65e6-d173-4ab1-8694-9cf7076b5c82 req-04e8ff87-f222-4af9-bb88-570a9288e635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6497f794-a65e-4cfc-bdf4-2c86963aab66", "tag": "85b82fde-62a0-4ff4-82c2-3f84b41e6bc1"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:01.600322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:01.607341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a1a65e6-d173-4ab1-8694-9cf7076b5c82 req-04e8ff87-f222-4af9-bb88-570a9288e635 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.608133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a1a65e6-d173-4ab1-8694-9cf7076b5c82 req-04e8ff87-f222-4af9-bb88-570a9288e635 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.622394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:01.622660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:01.650934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.651549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.652666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.653266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.675458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2a1a65e6-d173-4ab1-8694-9cf7076b5c82 req-04e8ff87-f222-4af9-bb88-570a9288e635 service nova] Creating event network-changed:85b82fde-62a0-4ff4-82c2-3f84b41e6bc1 for instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 on hv-cinder-82634 Jun 18 08:13:01.680809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2a1a65e6-d173-4ab1-8694-9cf7076b5c82 req-04e8ff87-f222-4af9-bb88-570a9288e635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348372 Jun 18 08:13:01.682965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 369/744] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:01.690422 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea91429b-c5ba-4987-90fb-eed6e5a5c150"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:01.692047 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:01.699312 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.699858 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.700636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.701070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.830078 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments HTTP/1.1 Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 74 Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:01.832240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {"volumeAttachment": {"volumeId": "ea91429b-c5ba-4987-90fb-eed6e5a5c150"}} Jun 18 08:13:01.833670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '4d0db5b5-f762-45a3-9c16-d43416d4ed1f', 'body': {'volumeAttachment': {'volumeId': 'ea91429b-c5ba-4987-90fb-eed6e5a5c150'}}} Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:01.834429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:01.835666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:01.836902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:01.836902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:01.836902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:01.836902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f Jun 18 08:13:01.836902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:01.839556 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 400 to user: Invalid volume: volume ea91429b-c5ba-4987-90fb-eed6e5a5c150 is already attached to instances: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:01.840724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-336a844d-40ac-4195-ba2d-be83709168d0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.155698 Jun 18 08:13:01.842058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 370/745] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:13:01 2022] POST /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:13:01.867170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:01.877576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:01.879355 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:01.880910 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4771f5a7-e697-4879-afb0-063c410373d5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.263156 Jun 18 08:13:01.892859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 376/746] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:01 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:13:01.915193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:01.915696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:01.923712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.924495 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:01.925572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:01.926237 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.019289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lazy-loading 'services' on Instance uuid 4d0db5b5-f762-45a3-9c16-d43416d4ed1f {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:13:02.109689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6fd5f94e-9ea8-4782-9cb7-f88107249b34 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments/ea91429b-c5ba-4987-90fb-eed6e5a5c150" status: 202 len: 0 microversion: 2.1 time: 0.198436 Jun 18 08:13:02.110298 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 371/747] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:13:01 2022] DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments/ea91429b-c5ba-4987-90fb-eed6e5a5c150 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:02.118645 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:02.120179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:02.128899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.129588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.130349 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.130967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.163551 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f21d545b-0843-4f3b-9d64-5ad96485b780 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048692 Jun 18 08:13:02.164836 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 377/748] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:02 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:02.219224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:02.222172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:02.236020 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.236761 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.237998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.240714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.471208 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:02.481765 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d8ce2d6f-5d23-4216-b58c-50cd4190c224 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.266887 Jun 18 08:13:02.482494 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 372/749] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:02 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:02.903411 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:02.904030 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:02.910782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.911240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:02.912063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:02.912480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:03.045973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:03.054294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:03.055822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:03.057007 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1881ad1a-04b0-43d8-ab4e-781edb659b01 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1740 microversion: 2.20 time: 0.159733 Jun 18 08:13:03.057964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 378/750] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:02 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:03.175789 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:03.176792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:03.183561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:03.184016 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:03.184785 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:03.185223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:03.214342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-69b7ae5b-c9b8-43de-b1f9-7c8e68225158 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jun 18 08:13:03.214884 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 373/751] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:03 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:03.498812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:03.499437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:03.506303 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:03.506743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:03.507535 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:03.507963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:03.642327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:03.650051 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3ba60145-a11b-4dd2-ad62-4077eca04d05 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.155236 Jun 18 08:13:03.650650 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 379/752] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:03 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:04.076168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:04.076793 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:04.083749 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.084199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.084955 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.085404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.226000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:04.227327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:04.233755 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.234207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.234976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.235458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.273627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f923bf0a-bcd3-4804-955b-fee91d4a723b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051539 Jun 18 08:13:04.274322 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 380/753] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:04 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:04.623895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:04.632721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:04.634225 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:04.636094 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0fdae46-fcff-4add-b0f5-c4064ce6b0da tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1722 microversion: 2.20 time: 0.564102 Jun 18 08:13:04.636662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 374/754] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:04 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1722 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:04.666600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:04.667192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:04.674310 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.674870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.675697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:04.676119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:04.823152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:04.831560 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3510c8c7-14cb-4774-a5ba-0dc9fe4a4e46 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.168811 Jun 18 08:13:04.832134 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 381/755] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:04 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:05.287661 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:05.288952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:05.300318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.300947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.302013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.302618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.336616 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9ae64c4f-c61a-422c-aeac-ecce1ccfbbb2 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Jun 18 08:13:05.336616 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 375/756] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:05 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:05.654382 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:05.654981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:05.661481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.661922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.662663 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.663108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.795046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:05.803044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:05.804521 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:05.805664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9d797441-bd6e-44c3-ab35-b3ba345f8358 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1722 microversion: 2.20 time: 0.155277 Jun 18 08:13:05.806225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 382/757] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:05 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:05.851155 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:05.851748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:05.858266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.858710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.859507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:05.859931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:05.993136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:06.001167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f8561df9-4db0-4ebe-b3aa-9f7ff5cea6a0 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.154207 Jun 18 08:13:06.001733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 376/758] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:05 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:06.350100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:06.351885 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:06.359905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:06.360355 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:06.361130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:06.361580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:06.391870 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7c8ae79-f61c-472b-826d-a87cdff48724 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048474 Jun 18 08:13:06.392439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 383/759] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:06 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:06.826946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:06.827579 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:06.834527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:06.834972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:06.835809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:06.836242 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:06.980435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:06.989153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:06.990809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:06.992481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-132adf24-359b-4061-8419-644902568f6d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1722 microversion: 2.20 time: 0.170788 Jun 18 08:13:06.993120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 377/760] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:06 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:07.017772 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:07.018369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:07.025055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:07.025537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:07.026289 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:07.026715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:07.161541 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:07.169539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ff6ad28c-30f9-4028-ab69-8f0999e92561 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.155621 Jun 18 08:13:07.170103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 384/761] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:07 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:07.406341 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:07.407458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:07.410966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:07.415673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:07.416206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:07.417170 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:07.417701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:07.418602 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:07.452544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7ef16f4e-e529-43f4-871f-8fa91c13374f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051493 Jun 18 08:13:07.453307 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 378/762] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:07 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:07.611364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9e35e2d4-99c7-47e5-a422-a223ffa9e4d4 req-85da1969-9780-470b-8a54-b21a2bb7b233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6497f794-a65e-4cfc-bdf4-2c86963aab66", "name": "network-vif-plugged", "status": "completed", "tag": "85b82fde-62a0-4ff4-82c2-3f84b41e6bc1"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:07.616899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:07.623180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e35e2d4-99c7-47e5-a422-a223ffa9e4d4 req-85da1969-9780-470b-8a54-b21a2bb7b233 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:07.623697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e35e2d4-99c7-47e5-a422-a223ffa9e4d4 req-85da1969-9780-470b-8a54-b21a2bb7b233 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:07.634627 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-9e35e2d4-99c7-47e5-a422-a223ffa9e4d4 req-85da1969-9780-470b-8a54-b21a2bb7b233 service nova] Creating event network-vif-plugged:85b82fde-62a0-4ff4-82c2-3f84b41e6bc1 for instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 on hv-cinder-82634 Jun 18 08:13:07.639780 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-9e35e2d4-99c7-47e5-a422-a223ffa9e4d4 req-85da1969-9780-470b-8a54-b21a2bb7b233 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Jun 18 08:13:07.640460 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 385/763] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:08.011049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.011659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.018516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.018964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.019757 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.020189 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.167458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:08.176002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:08.177878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:08.179226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-20d2f241-3e37-40c8-9d81-43a73b0f7256 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1725 microversion: 2.20 time: 0.172127 Jun 18 08:13:08.179791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 379/764] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:08 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:08.187294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.188035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.198694 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fc072d9-ad6b-45ac-aca7-27811103a0ed"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:08.199991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.202574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.203068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.203837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.204263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.206281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.206813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.207712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.208212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.355674 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:08.363864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7375a4a-5d11-4f16-8d86-edffc7425d11 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.181269 Jun 18 08:13:08.367061 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 386/765] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:08 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:08.463309 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.464404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.470854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.471425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.472242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.472733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.489333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:08.503210 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-32a612b1-a933-4452-8817-188ecd9e8411 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Jun 18 08:13:08.507287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 387/766] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:08 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:08.531676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-243722f7-aa35-4956-b755-0d949a7db7cf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336035 Jun 18 08:13:08.537113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 380/767] 10.222.0.23 () {62 vars in 1363 bytes} [Sat Jun 18 08:13:08 2022] POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 08:13:08.619034 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.619988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.627614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.628179 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.628773 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.629195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.658524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f819768e-1a43-4f5b-b4dd-4530af6cf793 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043409 Jun 18 08:13:08.659102 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 388/768] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:08 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:08.659958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.660529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.667657 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.668162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.668929 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.669355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.673322 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:08.800237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.800739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.806978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.807825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.808683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.809106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.837684 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0e206f2e-2cea-4e40-967b-d035a18c6b8c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce" status: 200 len: 194 microversion: 2.1 time: 0.041354 Jun 18 08:13:08.838237 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 389/769] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 08:13:08 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:13:08.847730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:08.848233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.854064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.854506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.855306 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.855785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.929846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f234a15a-1db9-467b-9176-352384c79629 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments/7fc072d9-ad6b-45ac-aca7-27811103a0ed" status: 202 len: 0 microversion: 2.20 time: 0.273553 Jun 18 08:13:08.934471 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 381/770] 10.222.0.23 () {60 vars in 1456 bytes} [Sat Jun 18 08:13:08 2022] DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments/7fc072d9-ad6b-45ac-aca7-27811103a0ed => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 18 08:13:08.942149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lazy-loading 'services' on Instance uuid 1e53340a-d169-4af3-ac69-237f29936c85 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:13:08.988693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:08.989528 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:08.995743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.996287 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:08.997048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:08.997510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.017097 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e60c2f0-5e50-4c77-bd0a-033cace486cc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce" status: 202 len: 0 microversion: 2.1 time: 0.172671 Jun 18 08:13:09.017712 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 390/771] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:13:08 2022] DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/02ff7cb3-45b8-4ebe-93d7-709e48521cce => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:09.078767 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-854eb09c-d120-4763-ba16-d2a1d88b9ed9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/action" status: 202 len: 0 microversion: 2.20 time: 0.094617 Jun 18 08:13:09.079435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 382/772] 10.222.0.23 () {62 vars in 1318 bytes} [Sat Jun 18 08:13:08 2022] POST /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 18 08:13:09.088002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:09.088720 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:09.095836 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.096373 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.097273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.097855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.232868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:09.240822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:09.242299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:09.243474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d103600a-64b6-4e97-949b-b9dffe652ebf tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1673 microversion: 2.20 time: 0.159772 Jun 18 08:13:09.244029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 391/773] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:09 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:09.382869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:09.383588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:09.389881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.390330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.391842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.392290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.514024 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:09.515025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:09.521329 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.521764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.522524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.522922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.524335 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:09.532227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c0c48ae7-222b-49ed-beba-414954c6019d tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1315 microversion: 2.1 time: 0.153215 Jun 18 08:13:09.533097 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 383/774] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:09 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:09.556334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1a61d06a-81df-4680-99f5-031ee8536166 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046132 Jun 18 08:13:09.556892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 392/775] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:09 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 08:13:09.617560 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:09.618191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:09.624883 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.625393 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.626226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.626718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.656093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:13:09.668092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9e4ed9a8-b373-4423-bf28-6507b8d6053b req-a90efa43-aae5-4724-ab96-686184cde0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "name": "network-vif-unplugged", "status": "completed", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:09.676791 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e4ed9a8-b373-4423-bf28-6507b8d6053b req-a90efa43-aae5-4724-ab96-686184cde0aa service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.677263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e4ed9a8-b373-4423-bf28-6507b8d6053b req-a90efa43-aae5-4724-ab96-686184cde0aa service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.690077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.compute.server_external_events [req-9e4ed9a8-b373-4423-bf28-6507b8d6053b req-a90efa43-aae5-4724-ab96-686184cde0aa service nova] Unable to find a host for instance bd41f096-17fd-4698-b185-6ff22ddb8826. Dropping event network-vif-unplugged {{(pid=117615) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 08:13:09.690978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-9e4ed9a8-b373-4423-bf28-6507b8d6053b req-a90efa43-aae5-4724-ab96-686184cde0aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026718 Jun 18 08:13:09.691841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 393/776] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 18 08:13:09.743189 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6d9d89b9-8824-4084-9fc4-fbf978204ad8 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 204 len: 0 microversion: 2.1 time: 0.129413 Jun 18 08:13:09.743809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 384/777] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:13:09 2022] DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:13:09.752794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:09.753500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:09.761433 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.761979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.762810 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:09.763376 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:09.904948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:09.912664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ca3c1880-30c2-4920-b214-7b38489aaeb5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1683 microversion: 2.1 time: 0.163803 Jun 18 08:13:09.913243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 394/778] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:09 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:10.266729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:10.267896 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:10.278377 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.278826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.279622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.280055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.411847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:10.421398 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:10.422887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:10.424084 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c20d6e0f-d31a-4f35-9eed-d29b25c1b5ca tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1673 microversion: 2.20 time: 0.164497 Jun 18 08:13:10.424655 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 385/779] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:10 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:10.553891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:10.554766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:10.564759 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.565375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.566272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.566816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.700225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:10.708070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99d2f0b5-ee14-4adb-832c-e36bc5560479 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1465 microversion: 2.1 time: 0.160948 Jun 18 08:13:10.708646 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 395/780] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:10 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:10.749889 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:10.750382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:10.756841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.757294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.758055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.758489 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.784337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:13:10.871149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-87c698cd-9bd2-446c-a915-056d15880e54 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 204 len: 0 microversion: 2.1 time: 0.124783 Jun 18 08:13:10.871727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 386/781] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:13:10 2022] DELETE /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:13:10.883201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:10.883901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:10.891027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.891484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.892231 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.892659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.930390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:10.930969 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:10.939468 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.939919 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:10.940691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:10.941124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:11.019752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:11.027539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a179f555-a72c-49a1-8606-5c86ee95a164 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1471 microversion: 2.1 time: 0.150935 Jun 18 08:13:11.028110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 396/782] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:10 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:11.074108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:11.085597 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b2c23939-7d33-4b0d-9ecf-30245486cc9e tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1683 microversion: 2.1 time: 0.159271 Jun 18 08:13:11.086449 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 387/783] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:10 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:11.445544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:11.446569 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:11.453940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:11.454455 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:11.455260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:11.455892 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:11.586955 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:11.595332 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:11.596839 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:11.597975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ca4c78bd-0ecf-4323-8e62-7d09ddf11529 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1673 microversion: 2.20 time: 0.158142 Jun 18 08:13:11.598552 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 397/784] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:11 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:12.050281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:12.051235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:12.061222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.061667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.062429 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.062857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.105039 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:12.105862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:12.111952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.112395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.113154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.113575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.198394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:12.206417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5bc9f8bb-59f4-492b-8345-715f4bd6bae1 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1471 microversion: 2.1 time: 0.162527 Jun 18 08:13:12.207588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 388/785] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:12 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:12.246233 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:12.256292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5a83b34-07f6-4a18-9f25-4e5b012be18d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1683 microversion: 2.1 time: 0.155754 Jun 18 08:13:12.256876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 398/786] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:12 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:12.616473 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:12.617112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:12.623593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.624064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.624838 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:12.625269 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:12.760887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:12.769006 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:12.770485 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:12.771663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a23b2d06-fc64-49d9-8b75-d91c6767f556 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1675 microversion: 2.20 time: 0.159306 Jun 18 08:13:12.772230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 389/787] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:12 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:13.223837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:13.224440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:13.232558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.233263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.233757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.234343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.275362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:13.276291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:13.287245 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.289127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.291530 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.292390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.385154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:13.392868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c12f6701-d14e-4762-af58-dda878d406c6 tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1471 microversion: 2.1 time: 0.173038 Jun 18 08:13:13.393985 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 399/788] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:13 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:13.687810 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:13.695317 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-34d6da30-80e6-4625-b6c5-7642b3460be1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1683 microversion: 2.1 time: 0.424663 Jun 18 08:13:13.695908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 390/789] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:13 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1683 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:13.792491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:13.793270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:13.799883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.800320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.801072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:13.801496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:13.943973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:13.952142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:13.953657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:13.954818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7a8a0f2-ef60-4393-be5f-902624d91233 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.166289 Jun 18 08:13:13.955400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 400/790] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:13 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:14.338369 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-fb7f3911-f7b1-4c7f-a6b3-43f33becdcbb req-7b676dc8-bb55-4205-b308-15613a92c01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6497f794-a65e-4cfc-bdf4-2c86963aab66", "name": "network-vif-deleted", "tag": "85b82fde-62a0-4ff4-82c2-3f84b41e6bc1"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:14.369054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fb7f3911-f7b1-4c7f-a6b3-43f33becdcbb req-7b676dc8-bb55-4205-b308-15613a92c01a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.369907 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fb7f3911-f7b1-4c7f-a6b3-43f33becdcbb req-7b676dc8-bb55-4205-b308-15613a92c01a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.385945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:14.386566 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:14.393624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.394304 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.395321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.396104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.464606 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d64c2a9-0ebf-46af-925d-3ece2b76bfa4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/2b021f2b-3ed0-403f-8a3b-d883999011ce" status: 200 len: 194 microversion: 2.1 time: 0.082409 Jun 18 08:13:14.471319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 401/791] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Jun 18 08:13:14 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/2b021f2b-3ed0-403f-8a3b-d883999011ce => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:14.476530 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:14.477247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:14.484582 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.485331 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.486333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.487001 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.525196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.526078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.526757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lazy-loading 'fault' on Instance uuid 6497f794-a65e-4cfc-bdf4-2c86963aab66 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:13:14.576263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeb9b06d72f43abae981722be3bfbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b851c318437948ff89683420f078ebb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:14.582162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:14.585092 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-fb7f3911-f7b1-4c7f-a6b3-43f33becdcbb req-7b676dc8-bb55-4205-b308-15613a92c01a service nova] Creating event network-vif-deleted:85b82fde-62a0-4ff4-82c2-3f84b41e6bc1 for instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 on hv-cinder-82634 Jun 18 08:13:14.586005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30e37a84-9c6f-4de7-859a-4f3f1a67413f tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 200 len: 1305 microversion: 2.1 time: 0.113242 Jun 18 08:13:14.586598 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 402/792] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:14 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:14.590311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-fb7f3911-f7b1-4c7f-a6b3-43f33becdcbb req-7b676dc8-bb55-4205-b308-15613a92c01a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256773 Jun 18 08:13:14.591277 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 391/793] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:14.592705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:14.593359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:14.600057 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.600508 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.601311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.601745 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.679557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:14.683849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lazy-loading 'services' on Instance uuid 1e53340a-d169-4af3-ac69-237f29936c85 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:13:14.714741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:14.715424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:14.723070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.723545 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.724479 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.725238 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.777820 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8c1683b-59ff-4ccb-a6ed-39d5d515666e tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/2b021f2b-3ed0-403f-8a3b-d883999011ce" status: 202 len: 0 microversion: 2.1 time: 0.189550 Jun 18 08:13:14.778348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 403/794] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:13:14 2022] DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments/2b021f2b-3ed0-403f-8a3b-d883999011ce => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:14.835300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:14.849436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-666b0490-98de-4f13-af14-1e24aa09c4d3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1615 microversion: 2.1 time: 0.140088 Jun 18 08:13:14.850193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 392/795] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:14 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1615 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:14.976614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:14.977716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:14.989986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.991084 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:14.992506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:14.993786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.151153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:15.159159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:15.160639 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:15.161789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-55d285ab-789b-423a-ac2c-2b16f5c322ad tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.192218 Jun 18 08:13:15.162352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 404/796] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:14 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:15.603254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:15.603845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] [instance: 6497f794-a65e-4cfc-bdf4-2c86963aab66] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:15.610762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:15.611350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.612315 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:15.612827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.627505 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] HTTP exception thrown: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Request method failure captured: Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 HTTP/1.1 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYkGCkDzuRlwcNB2La7KU9KGiS6hhImeo_eih6092oX_eOAK-asFvcdz7Jk3NVY9_pV-VCkGkf1i1xJkdkeUh4cmBRzFuNyAzuO4JW7s2-306ZEzi9s0erGwKGAW52CffALah-ErAso83qz1e5mnSpV8-UjeSJn54h7M35saPeei4G8 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: b851c318437948ff89683420f078ebb8 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-1644723972 Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:15.629213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b851c318437948ff89683420f078ebb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b851c318437948ff89683420f078ebb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b851c318437948ff89683420f078ebb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b851c318437948ff89683420f078ebb8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-1644723972 Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: b851c318437948ff89683420f078ebb8 Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-1644723972 Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-1644723972-project Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 0aeb9b06d72f43abae981722be3bfbb9 Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-1644723972-project Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. Jun 18 08:13:15.630703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '6497f794-a65e-4cfc-bdf4-2c86963aab66'} Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:15.631639 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. Jun 18 08:13:15.632997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:15.634174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] Returning 404 to user: Instance 6497f794-a65e-4cfc-bdf4-2c86963aab66 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:15.634174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8a8cba27-0976-4c04-bc8a-85638868c79e tempest-VolumesNegativeTest-1644723972 tempest-VolumesNegativeTest-1644723972-project] 10.222.0.23 "GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66" status: 404 len: 111 microversion: 2.1 time: 0.031363 Jun 18 08:13:15.634174 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 393/797] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:15 2022] GET /compute/v2.1/servers/6497f794-a65e-4cfc-bdf4-2c86963aab66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:15.867929 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:15.868658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:15.882252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:15.882691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.883550 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:15.883974 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.963387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:15.963927 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:15.964557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lazy-loading 'fault' on Instance uuid 4d0db5b5-f762-45a3-9c16-d43416d4ed1f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:13:16.027977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:16.036168 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e681a768-11e0-40c4-a64b-787614b86c28 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 200 len: 1332 microversion: 2.1 time: 0.174198 Jun 18 08:13:16.036977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 405/798] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:15 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 1332 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:16.183806 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:16.185125 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:16.194272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:16.195229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:16.197212 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:16.197964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:16.358216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:16.372598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:16.377365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:16.380124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a043aa3b-080d-4dfe-b28c-a2baab26b5a4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.202662 Jun 18 08:13:16.380937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 394/799] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:16 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:16.610674 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-de46e282-941a-4fdd-b8ea-e36b7c48b114 req-a7aa4f49-0ebd-4236-99d1-3249460c254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0db5b5-f762-45a3-9c16-d43416d4ed1f", "name": "network-vif-deleted", "tag": "34d646f8-d1f1-4dda-a910-284ea3e57139"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:16.629670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-de46e282-941a-4fdd-b8ea-e36b7c48b114 req-a7aa4f49-0ebd-4236-99d1-3249460c254a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:16.630190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-de46e282-941a-4fdd-b8ea-e36b7c48b114 req-a7aa4f49-0ebd-4236-99d1-3249460c254a service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:16.643452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-de46e282-941a-4fdd-b8ea-e36b7c48b114 req-a7aa4f49-0ebd-4236-99d1-3249460c254a service nova] Creating event network-vif-deleted:34d646f8-d1f1-4dda-a910-284ea3e57139 for instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f on hv-cinder-82634 Jun 18 08:13:16.663979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-de46e282-941a-4fdd-b8ea-e36b7c48b114 req-a7aa4f49-0ebd-4236-99d1-3249460c254a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059955 Jun 18 08:13:16.669400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 406/800] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:17.076043 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.078038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.085435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.086253 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.087270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.087904 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.146231 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-561b1bdb-cf91-4b21-bc65-b11c6026a869 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074838 Jun 18 08:13:17.152320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 407/801] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:17 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 08:13:17.194869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.195622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.223732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.224267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.224945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.225374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.264922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f HTTP/1.1 Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:17.268758 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:13:17.270346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '4d0db5b5-f762-45a3-9c16-d43416d4ed1f'} Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:17.271516 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:13:17.274622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:17.277578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:17.278764 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-533e01cb-b513-42e1-95c5-14c6cf17a530 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 404 len: 111 microversion: 2.1 time: 0.228782 Jun 18 08:13:17.279735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.280896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.286913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 395/802] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:17 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:17.288357 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.289035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.290035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.290665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.301779 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-719e2498-1a22-41fa-a933-2e5e1caa0bc3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '.version_select at 0x7f3be41e34c0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.326907 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-719e2498-1a22-41fa-a933-2e5e1caa0bc3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792137633" status: 202 len: 0 microversion: 2.1 time: 0.035117 Jun 18 08:13:17.328017 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 396/803] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 08:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792137633 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:17.339003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a0acab83-5982-4433-ac9e-dd7713436e93 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064965 Jun 18 08:13:17.344501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 408/804] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:13:17 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:13:17.401669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.402405 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.414787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.415365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.416237 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.416902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.441704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.442217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.450544 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.451045 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.451825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.452370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.487780 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:13:17.707193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7d5f59f8-c639-47c6-8c67-d1e9df32a21c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 204 len: 0 microversion: 2.1 time: 0.271194 Jun 18 08:13:17.711468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 409/805] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:13:17 2022] DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:13:17.719803 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:17.720454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:17.737328 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.737793 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.738543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:17.738965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:17.763921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:17.774751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:17.776954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:17.778656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cc8f526-7bdd-48e6-ad8b-d28ce2bfbeb2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.381401 Jun 18 08:13:17.791048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 397/806] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:17 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:18.329590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:18.337229 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e4895644-8be6-4836-ba3f-63b61753a99c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.624430 Jun 18 08:13:18.337927 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 410/807] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:17 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:18.700514 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f434fb4-165d-4c1c-a7bd-3d318008d0fd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: .version_select at 0x7f3be41e33a0>, body: {"keypair": {"name": "tempest-keypair-2107021071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMJ81NM0RIA37F+XraXdvPdI3pKjFo9xX8ZHN9UBWwREkYst2nr7HO8/y3G8lx6PHtV+RbePXVqredfzEcCab/SEdNsp4AieoDlyCEl0O1oY0IeEad9r2VmR679E6/cNg=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:18.717403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2f434fb4-165d-4c1c-a7bd-3d318008d0fd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:13:18.722959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2f434fb4-165d-4c1c-a7bd-3d318008d0fd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:13:18.759372 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f434fb4-165d-4c1c-a7bd-3d318008d0fd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063676 Jun 18 08:13:18.761610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 398/808] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:13:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:18.800217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:18.801889 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:18.811044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:18.811978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:18.813254 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:18.813946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:19.011832 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:19.020364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:19.022076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:19.023494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2735c79f-b1dc-4dc6-97a4-7a00f039a5b3 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.228222 Jun 18 08:13:19.024260 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 411/809] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:18 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:19.354180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:19.355263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:19.367521 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:19.368511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:19.369309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:19.369742 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:19.742923 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:19.750690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f200aa57-8952-4531-a53b-ca59cb202c80 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.400525 Jun 18 08:13:19.751305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 399/810] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:19 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:20.042762 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:20.043391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:20.050977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:20.051571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:20.052343 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:20.052763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:20.199196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:20.207266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:20.208752 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:20.209972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-171eeb05-0236-44fd-b0be-d06566ae20aa tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.171558 Jun 18 08:13:20.210533 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 412/811] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:20 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:20.770359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:20.771844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:20.783692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:20.783692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:20.783692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:20.783692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:20.823794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-371949740", "imageRef": "b44c1cd5-723c-4589-a404-7b0bfbba44d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626"}], "security_groups": [{"name": "tempest-securitygroup--800370109"}], "key_name": "tempest-keypair-2107021071", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:20.924971 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:20.933606 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] validate_networks() for [('bfdfe6d6-80ac-4a6e-95a7-fc1f3a1a2626', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:13:20.938456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c667a7bd-55ed-4004-aeee-d729b5054bc9 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.174109 Jun 18 08:13:20.939222 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:20 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:21.228120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:21.229032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:21.240827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.241762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:21.243901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.246508 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:21.404916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:21.412855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:21.414349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:21.415640 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ffa91f5a-2b4d-492b-9584-f61d230c100c tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.191302 Jun 18 08:13:21.416110 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 401/813] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:21 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:21.580678 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:13:21.581109 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:13:21.581542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:13:21.581970 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:13:21.583125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:13:21.597687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.600753 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:21.602724 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.604104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:21.626101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:13:21.630566 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Getting quotas for user bc7cd82812d741258ed729bf5b218567 and project c8f4ea5f647f4006a87f41f366772afa. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:13:21.641782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:21.643564 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:13:21.646178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b44c1cd5-723c-4589-a404-7b0bfbba44d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:13:21.702217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5025d6d2-703a-47ec-9a59-5e20969165d6 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.882853 Jun 18 08:13:21.708524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 413/814] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:13:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:13:21.713461 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-709da92b-2b6f-494b-acd6-de2e5bad9823 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:21.714529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-709da92b-2b6f-494b-acd6-de2e5bad9823 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:21.791607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-709da92b-2b6f-494b-acd6-de2e5bad9823 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:21.800557 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-709da92b-2b6f-494b-acd6-de2e5bad9823 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1241 microversion: 2.1 time: 0.090042 Jun 18 08:13:21.801510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 402/815] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:21 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:21.957474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:21.958780 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:21.991293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.991858 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:21.993941 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:21.995622 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:22.223149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:22.231969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-177ece68-a55b-42a0-8960-feb03bd27c94 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.279368 Jun 18 08:13:22.233341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 414/816] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:21 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:22.434219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:22.435136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:22.441244 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:22.441683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:22.442432 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:22.442862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:22.615933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:22.625844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:22.627801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:22.631333 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9802f9af-bbae-4dc6-8192-a0f991389ae9 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.201438 Jun 18 08:13:22.632920 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 403/817] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:22 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:22.818695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:22.819435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:22.826285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:22.826898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:22.827846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:22.833679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:22.941618 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:22.956578 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ce447f9-a044-40dc-8417-bbbb7e17284d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.141928 Jun 18 08:13:22.957835 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 415/818] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:22 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:23.250511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:23.251281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:23.258310 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.258885 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:23.259773 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.260290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:23.399053 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:23.408119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d6653da8-0625-41c6-a958-9bc1c9afbff8 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.161960 Jun 18 08:13:23.415901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 404/819] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:23 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:23.651779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:23.652385 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:23.658805 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.659499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:23.660273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.660696 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:23.808268 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:23.821035 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:23.823633 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:23.825027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4fbb91a8-8298-4819-bed4-f2c32a3d5344 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.178702 Jun 18 08:13:23.825767 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 416/820] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:23 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:23.974142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:23.974747 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:23.976795 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:23.983499 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.984033 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:23.985360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:23.986045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:24.048566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:24.059488 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7a7476d-5b14-4134-bf35-70f8d481423f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.089149 Jun 18 08:13:24.060234 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 405/821] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:23 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:24.427983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:24.429076 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:24.452539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:24.452981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:24.453760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:24.454205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:24.614722 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:24.622846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73e5e870-80fd-472d-8a9b-286c196c9817 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.199809 Jun 18 08:13:24.623462 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 417/822] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:24 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:24.843908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:24.844536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:24.851433 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:24.851880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:24.852643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:24.853077 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:24.985325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:24.993371 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:24.994887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:24.996116 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-da9dbc27-1b27-43d3-9a23-14686a697dd0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.156278 Jun 18 08:13:24.996642 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 406/823] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:24 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:25.079049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:25.079787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:25.087739 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:25.088299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:25.089194 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:25.089703 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:25.152599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:25.160181 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-338533d6-bc5d-4243-87a3-ff0eb4d114d1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.085722 Jun 18 08:13:25.160771 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 418/824] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:25 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:25.643826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:25.644709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:25.657665 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:25.658398 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:25.659707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:25.660437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:25.799326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:25.811534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-03cd7be9-da51-450b-aaec-7071f0b1f410 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.174076 Jun 18 08:13:25.812259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 407/825] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:25 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:26.018474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:26.019055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:26.028130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.028583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.029337 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.029756 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.033707 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:26.162626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:26.170827 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:26.172432 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:26.173616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-36d9d682-1962-448f-9aa0-84c8edd8d4c5 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.161685 Jun 18 08:13:26.174171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 419/826] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:26 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:26.177120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:26.177783 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:26.184672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.185120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.185876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.186300 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.258450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:26.266263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b196d20f-7392-4525-98b1-a58bec101bd3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.093110 Jun 18 08:13:26.266829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 408/827] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:26 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:26.837581 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:26.838436 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:26.848662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.849395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.850608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:26.851390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:26.994359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:27.006147 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fdb699b-fc2e-4b56-9eea-87fbce007f8d tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.174874 Jun 18 08:13:27.006905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 420/828] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:26 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:27.196313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:27.197318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:27.208491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:27.209276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:27.210533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:27.211291 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:27.283464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:27.284072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:27.290698 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:27.291178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:27.291947 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:27.292372 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:27.349438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:27.355341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:27.357652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:27.359167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:27.360323 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-43e6ee37-a1f4-4201-aedb-605afa20968e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.170639 Jun 18 08:13:27.360850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 409/829] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:27 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:27.362732 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d7214a1-2463-468a-8c37-4939be36f120 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.083250 Jun 18 08:13:27.363296 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 421/830] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:27 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:28.028481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:28.029108 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:28.035705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.036156 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.036914 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.037349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.175678 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:28.184257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1bdbaeca-34ae-4369-b1c4-00a7f3b601e2 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.161891 Jun 18 08:13:28.184829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 410/831] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:28 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:28.379229 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:28.379829 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:28.380190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:28.380306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:28.386926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.387138 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.387469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.387713 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.388249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.388480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:28.388624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.388903 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:28.451285 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:28.458777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f014d8b-52e8-403d-9ba6-85b79ac53eed tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1245 microversion: 2.1 time: 0.083034 Jun 18 08:13:28.459520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 411/832] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:28 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:28.522465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:28.530498 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:28.531995 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:28.533128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e4d5bdce-7217-445d-a189-8286ce656951 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.157976 Jun 18 08:13:28.533663 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 422/833] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:28 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:29.202527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:29.203085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:29.209658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.210102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.210856 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.211336 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.344937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:29.347187 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:29.353349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1804cc58-d6b3-4621-9d2e-ae07236bc105 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.154921 Jun 18 08:13:29.353917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 412/834] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:29 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:29.479912 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:29.480770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:29.491784 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.492528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.493833 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.494558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.551941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:29.552568 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:29.558864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:29.559878 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.560326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.561099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:29.561534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:29.566481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be80ec3e-5545-4fed-95ad-a18fa08f3692 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1237 microversion: 2.1 time: 0.093466 Jun 18 08:13:29.567106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 423/835] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:29 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:29.700079 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:29.713597 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:29.715125 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:29.716272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ddb21b13-179e-4073-a40b-5c8df472914d tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.168668 Jun 18 08:13:29.716860 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 413/836] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:29 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:30.375958 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:30.376846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:30.383304 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.383753 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.384495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.385155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.517779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:30.525478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f6e77a1-63fb-40f1-b37e-952419f258be tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1669 microversion: 2.1 time: 0.153478 Jun 18 08:13:30.526054 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 424/837] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:30 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:30.583816 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:30.584443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:30.591554 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.592069 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.593129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.593717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.684534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:30.692592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac37d455-9796-43a4-96de-350f4de1fbff tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1299 microversion: 2.1 time: 0.112787 Jun 18 08:13:30.693171 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 414/838] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:30 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:30.735208 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:30.735810 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:30.741928 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.742370 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.743143 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:30.743571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:30.886407 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:30.896239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:30.897748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:30.899119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5054b22b-5d85-4bf0-944e-1a1bf8b67474 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.168058 Jun 18 08:13:30.899682 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 425/839] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:30 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:31.455272 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-97fb66cd-2108-4bc8-9f7c-f425e9f39da9 req-92afc44d-4bcd-4b81-a368-77b9b04ae5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e53340a-d169-4af3-ac69-237f29936c85", "name": "network-vif-deleted", "tag": "438a19f0-250c-40c9-bebf-d7a6d1e44363"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:31.475329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-97fb66cd-2108-4bc8-9f7c-f425e9f39da9 req-92afc44d-4bcd-4b81-a368-77b9b04ae5c4 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.476119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-97fb66cd-2108-4bc8-9f7c-f425e9f39da9 req-92afc44d-4bcd-4b81-a368-77b9b04ae5c4 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.522102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-97fb66cd-2108-4bc8-9f7c-f425e9f39da9 req-92afc44d-4bcd-4b81-a368-77b9b04ae5c4 service nova] Creating event network-vif-deleted:438a19f0-250c-40c9-bebf-d7a6d1e44363 for instance 1e53340a-d169-4af3-ac69-237f29936c85 on hv-cinder-82634 Jun 18 08:13:31.527770 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-97fb66cd-2108-4bc8-9f7c-f425e9f39da9 req-92afc44d-4bcd-4b81-a368-77b9b04ae5c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083483 Jun 18 08:13:31.528798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 415/840] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:31.546666 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:31.548058 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:31.562002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.565897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.568439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.571119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.628464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:31.654999 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:31.712688 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:31.713620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:31.723470 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.724354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.726256 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.726937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.730731 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4580375d8069479ab2f18025be4d2128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273ac76b51f14a4998a14fcfb06009a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:31.768353 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5652da9f-3d19-4178-b296-3002f9219d2c tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 200 len: 1319 microversion: 2.1 time: 0.225705 Jun 18 08:13:31.769579 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 426/841] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:31 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:31.809065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:31.918783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:31.919326 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:31.928392 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.933374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:31.936857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:31.937669 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:32.117031 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:32.128960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e96f37ef-a351-414c-8156-b9d164c19c97 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.422556 Jun 18 08:13:32.130876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 416/842] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:31 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:13:32.143934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:32.155452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:32.158687 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:32.160425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f67ab187-3c0d-42dd-81bd-7fad5bd47d83 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.246104 Jun 18 08:13:32.161540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 427/843] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:31 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:32.786008 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:32.787316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:32.797551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:32.798233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:32.799343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:32.799922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:32.820724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 HTTP/1.1 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:32.822390 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:32.824104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '1e53340a-d169-4af3-ac69-237f29936c85'} Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:32.824945 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:32.826482 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:32.827892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:32.827892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-802b98db-debd-4062-b089-923351519435 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 404 len: 111 microversion: 2.1 time: 0.042128 Jun 18 08:13:32.827892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 417/844] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:32 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:32.833403 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a9b20340-8b6d-4fa7-8a43-a584ff104bd4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '.version_select at 0x7f3bdf0db790>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:32.857924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a9b20340-8b6d-4fa7-8a43-a584ff104bd4 tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92332512" status: 202 len: 0 microversion: 2.1 time: 0.028437 Jun 18 08:13:32.858509 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 428/845] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Jun 18 08:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92332512 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:33.146892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:33.147607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:33.153519 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.153961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.154710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.155161 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.179717 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:33.180374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:33.186738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.187215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.188059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.188482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.288864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:33.296780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7d7df17a-b187-41e0-a813-eeb1a328ba61 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.153824 Jun 18 08:13:33.306964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 418/846] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:33 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:33.404063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:33.412563 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:33.414127 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:33.415435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b17635ca-0989-4fab-b0a5-981a071d9226 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.239853 Jun 18 08:13:33.416047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 429/847] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:33 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:33.545058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-1fb9bd8e-975a-432e-a6a8-3863f3b050cf req-7bfe18a3-6f0d-4e77-9321-4f0c93830ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7845c8-de84-492a-8057-bb824810e9a1", "tag": "d73ec793-19cc-491b-af74-11b58248cf9a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:33.554013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1fb9bd8e-975a-432e-a6a8-3863f3b050cf req-7bfe18a3-6f0d-4e77-9321-4f0c93830ad9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.554724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1fb9bd8e-975a-432e-a6a8-3863f3b050cf req-7bfe18a3-6f0d-4e77-9321-4f0c93830ad9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.566654 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-1fb9bd8e-975a-432e-a6a8-3863f3b050cf req-7bfe18a3-6f0d-4e77-9321-4f0c93830ad9 service nova] Creating event network-changed:d73ec793-19cc-491b-af74-11b58248cf9a for instance 8b7845c8-de84-492a-8057-bb824810e9a1 on hv-cinder-82634 Jun 18 08:13:33.571833 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-1fb9bd8e-975a-432e-a6a8-3863f3b050cf req-7bfe18a3-6f0d-4e77-9321-4f0c93830ad9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030361 Jun 18 08:13:33.575252 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 419/848] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:33.693840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d00e7b24-72c0-4c7f-a8e5-b2815166a981 req-8d64b483-e950-4bb3-9a32-69a1fe1854d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "name": "network-vif-plugged", "status": "completed", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:33.706725 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d00e7b24-72c0-4c7f-a8e5-b2815166a981 req-8d64b483-e950-4bb3-9a32-69a1fe1854d6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:33.707313 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d00e7b24-72c0-4c7f-a8e5-b2815166a981 req-8d64b483-e950-4bb3-9a32-69a1fe1854d6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:33.728236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d00e7b24-72c0-4c7f-a8e5-b2815166a981 req-8d64b483-e950-4bb3-9a32-69a1fe1854d6 service nova] Creating event network-vif-plugged:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:13:33.733372 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d00e7b24-72c0-4c7f-a8e5-b2815166a981 req-8d64b483-e950-4bb3-9a32-69a1fe1854d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044394 Jun 18 08:13:33.734011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 430/849] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:34.315611 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:34.316445 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:34.322996 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:34.323546 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:34.324312 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:34.324740 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:34.436502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:34.437188 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:34.443965 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:34.444369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:34.445339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:34.445764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:34.460250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:34.468045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-45c1ce4a-de94-4468-91f3-0d8ebcbf9d49 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.157713 Jun 18 08:13:34.468618 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 420/850] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:34 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:34.579911 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:34.587837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:34.589340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:34.590491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e5d67db0-f3b8-45e0-8fb3-4f04925ea0d2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.158369 Jun 18 08:13:34.591108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 431/851] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:34 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:35.484998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:35.485596 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:35.492230 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.492647 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.493620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.494057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.612920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:35.614101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:35.621324 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.621825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.622604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.623038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.638430 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:35.656246 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0d9b0b57-8a2c-416d-86ea-5895ca64168b tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.174711 Jun 18 08:13:35.675754 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 421/852] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:35 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:35.771449 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:35.780438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:35.782243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:35.783715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7033866-deea-4013-a7cf-90f73faf32b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1731 microversion: 2.20 time: 0.178423 Jun 18 08:13:35.794452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 432/853] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:35 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:13:35.893451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:35.893940 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:35.900325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.900766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.901525 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.901949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.915543 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 HTTP/1.1 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:35.917213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.918841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '1e53340a-d169-4af3-ac69-237f29936c85'} Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:35.919780 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.921299 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.922845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:35.922845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6784f16b-ba49-417f-b37c-28b631f07fff tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 404 len: 111 microversion: 2.1 time: 0.029106 Jun 18 08:13:35.922845 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 422/854] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:13:35 2022] DELETE /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:35.932055 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:35.932777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: 1e53340a-d169-4af3-ac69-237f29936c85] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:35.939939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.940386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.941158 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:35.941588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:35.955531 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 HTTP/1.1 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:35.957218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.958872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '1e53340a-d169-4af3-ac69-237f29936c85'} Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:35.959715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. Jun 18 08:13:35.961101 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:35.962390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance 1e53340a-d169-4af3-ac69-237f29936c85 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:35.962390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6304c3a2-ab71-4ec9-96f8-dc5651efc9ae tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85" status: 404 len: 111 microversion: 2.1 time: 0.030893 Jun 18 08:13:35.962390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 433/855] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:35 2022] GET /compute/v2.1/servers/1e53340a-d169-4af3-ac69-237f29936c85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:36.677964 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:36.678929 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:36.689926 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:36.690345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:36.691128 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:36.691558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:36.802220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:36.802828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:36.812990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:36.813647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:36.813647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:36.813647 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:36.836642 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:36.844458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-91405725-dfa4-44a6-bd0b-cdbe969af07d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.173080 Jun 18 08:13:36.845118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 423/856] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:36 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:36.945671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:36.954170 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:36.955674 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:36.957394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9635d82a-c46e-430b-b38d-27db4318c409 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1718 microversion: 2.20 time: 0.159133 Jun 18 08:13:36.958163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 434/857] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:13:36 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:13:37.120290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:37.120791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:37.127286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.127739 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.128507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.128940 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.142570 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 HTTP/1.1 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:37.144154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.145691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'e15e626c-3e18-47cb-857d-b92aafddfbb4'} Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:37.146701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.148232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.149696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:37.149696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50265fc7-bec7-4969-86ab-bea9435210ab tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 404 len: 111 microversion: 2.1 time: 0.029195 Jun 18 08:13:37.149696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 424/858] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:13:37 2022] DELETE /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:37.153884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:37.154494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] [instance: e15e626c-3e18-47cb-857d-b92aafddfbb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:37.160922 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.161374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.162140 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.162572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.175926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] HTTP exception thrown: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Request method failure captured: Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 HTTP/1.1 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYemgQSOSnwrNDEJmxVlKkFDSVE901Y3ozOzS_jHA079Jjw0BoTr_paEFxUYmeXWo58Uyj70kWr-vA6m3K0IzOg9EhdAIyBzaXwjUuMVSBHzzNZOcdeocfwNthugoRsEViKQ4NftJTGe5RKg7bJzSJ5OMyTWq-VROwkuLKnw2JVGAu0 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:37.177447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/273ac76b51f14a4998a14fcfb06009a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_273ac76b51f14a4998a14fcfb06009a8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 273ac76b51f14a4998a14fcfb06009a8 Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-179995950 Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 4580375d8069479ab2f18025be4d2128 Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-179995950-project Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.179096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'e15e626c-3e18-47cb-857d-b92aafddfbb4'} Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:37.180204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. Jun 18 08:13:37.181990 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:37.183388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] Returning 404 to user: Instance e15e626c-3e18-47cb-857d-b92aafddfbb4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:37.183388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3685560c-57b5-4eef-8afe-292a3854f5dc tempest-AttachVolumeTestJSON-179995950 tempest-AttachVolumeTestJSON-179995950-project] 10.222.0.23 "GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4" status: 404 len: 111 microversion: 2.1 time: 0.028836 Jun 18 08:13:37.183388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 435/859] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:37 2022] GET /compute/v2.1/servers/e15e626c-3e18-47cb-857d-b92aafddfbb4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:37.706152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-a1e42dbc-8bca-4f69-ac91-5995375ed155 req-bfeeefc4-a252-45d6-9fe6-b8601a9d17bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7845c8-de84-492a-8057-bb824810e9a1", "name": "network-vif-plugged", "status": "completed", "tag": "d73ec793-19cc-491b-af74-11b58248cf9a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:37.715198 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a1e42dbc-8bca-4f69-ac91-5995375ed155 req-bfeeefc4-a252-45d6-9fe6-b8601a9d17bb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.715715 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a1e42dbc-8bca-4f69-ac91-5995375ed155 req-bfeeefc4-a252-45d6-9fe6-b8601a9d17bb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.727427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-a1e42dbc-8bca-4f69-ac91-5995375ed155 req-bfeeefc4-a252-45d6-9fe6-b8601a9d17bb service nova] Creating event network-vif-plugged:d73ec793-19cc-491b-af74-11b58248cf9a for instance 8b7845c8-de84-492a-8057-bb824810e9a1 on hv-cinder-82634 Jun 18 08:13:37.732201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-a1e42dbc-8bca-4f69-ac91-5995375ed155 req-bfeeefc4-a252-45d6-9fe6-b8601a9d17bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030312 Jun 18 08:13:37.732764 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 425/860] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:13:37.862959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:37.863648 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:37.870321 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.870764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:37.871565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:37.871988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:38.077801 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:38.086290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4e6a7a7d-e255-4be3-940c-25b5dc3d1cab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.227397 Jun 18 08:13:38.086856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 436/861] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:37 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:39.104180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:39.105112 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:39.111857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:39.112391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:39.113405 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:39.113921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:39.257111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:39.265904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-536f2b6d-4cb4-485b-b342-41ca742607fa tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1366 microversion: 2.1 time: 0.166952 Jun 18 08:13:39.266550 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 426/862] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:39 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:40.283474 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:40.284053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:40.291572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:40.292099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:40.292954 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:40.293386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:40.439057 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:13:40.447207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b0694b17-b9a1-42bc-af27-e1fed9a29803 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1556 microversion: 2.1 time: 0.167745 Jun 18 08:13:40.447744 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 437/863] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:13:40 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:13:40.466344 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:40.466830 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:13:40.473042 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:40.473495 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:40.474263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:40.474696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:40.579591 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6c5c11ef-f29a-41b3-a9da-f330f6759bab tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117206 Jun 18 08:13:40.585996 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 427/864] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Jun 18 08:13:40 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:41.774825 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-a4be605c-b682-4922-9da6-99e8a83dc1da req-860ecfd0-9671-4790-9732-5fc1aa653fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7845c8-de84-492a-8057-bb824810e9a1", "tag": "d73ec793-19cc-491b-af74-11b58248cf9a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:41.782667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a4be605c-b682-4922-9da6-99e8a83dc1da req-860ecfd0-9671-4790-9732-5fc1aa653fc7 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:13:41.783123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a4be605c-b682-4922-9da6-99e8a83dc1da req-860ecfd0-9671-4790-9732-5fc1aa653fc7 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:13:41.795156 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-a4be605c-b682-4922-9da6-99e8a83dc1da req-860ecfd0-9671-4790-9732-5fc1aa653fc7 service nova] Creating event network-changed:d73ec793-19cc-491b-af74-11b58248cf9a for instance 8b7845c8-de84-492a-8057-bb824810e9a1 on hv-cinder-82634 Jun 18 08:13:41.800494 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-a4be605c-b682-4922-9da6-99e8a83dc1da req-860ecfd0-9671-4790-9732-5fc1aa653fc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238651 Jun 18 08:13:41.801606 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 438/865] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:42.082789 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bc56c584-fcbd-40b1-8e70-8e754842e9c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Action: 'create', calling method: .version_select at 0x7f3be7ad18b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1101915910"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:42.414794 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bc56c584-fcbd-40b1-8e70-8e754842e9c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.463918 Jun 18 08:13:42.415774 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 428/866] 10.222.0.23 () {60 vars in 1154 bytes} [Sat Jun 18 08:13:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 466 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 18 08:13:42.428791 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-855be092-a5d9-42d4-a92d-2a04cc3e4499 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf07fb80>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:42.482207 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-855be092-a5d9-42d4-a92d-2a04cc3e4499 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 200 len: 345 microversion: 2.1 time: 0.058011 Jun 18 08:13:42.483057 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 439/867] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:42 2022] GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:13:43.500032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8672ce4f-a403-42f7-93a6-732038d4b487 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be4256700>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:43.559545 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8672ce4f-a403-42f7-93a6-732038d4b487 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 200 len: 346 microversion: 2.1 time: 0.066403 Jun 18 08:13:43.560443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 429/868] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:43 2022] GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:13:43.573375 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35935d93-0d6b-4ff5-98cd-e8005a9e5fb7 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Action: 'create', calling method: .version_select at 0x7f3bdf0ce3a0>, body: {"snapshot": {"volume_id": "7e8c5430-cd4c-49cb-adc6-26617f306e83", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-401417364"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:43.733341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35935d93-0d6b-4ff5-98cd-e8005a9e5fb7 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.164310 Jun 18 08:13:43.734043 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 440/869] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Jun 18 08:13:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:43.743995 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b24c3cc2-c6ef-4c68-ab69-0c6d52aec876 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be7ad1dc0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:43.773959 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b24c3cc2-c6ef-4c68-ab69-0c6d52aec876 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 200 len: 286 microversion: 2.1 time: 0.033896 Jun 18 08:13:43.774715 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 430/870] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:43 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:43.784588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7b4ec3b-92c8-4475-92d8-76b466839a69 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf07fa60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:43.814234 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7b4ec3b-92c8-4475-92d8-76b466839a69 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033574 Jun 18 08:13:43.814800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 441/871] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Jun 18 08:13:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:43.827534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4e4c569e-85c1-4f78-a4b7-2b923dda36eb tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be4177670>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:43.858302 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4e4c569e-85c1-4f78-a4b7-2b923dda36eb tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 200 len: 286 microversion: 2.1 time: 0.034604 Jun 18 08:13:43.859068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 431/872] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:43 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:44.877221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-faaed29a-df9e-4a82-9926-523e56bdd660 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf122a60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:44.912734 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-faaed29a-df9e-4a82-9926-523e56bdd660 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 200 len: 286 microversion: 2.1 time: 0.042760 Jun 18 08:13:44.913297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 442/873] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:44 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:45.926997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bc80d836-c932-410c-9c0c-a55b7bb1189a tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be428b550>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:45.958873 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bc80d836-c932-410c-9c0c-a55b7bb1189a tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 200 len: 286 microversion: 2.1 time: 0.037335 Jun 18 08:13:45.959440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 432/874] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:45 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:46.974102 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07cc6d5c-e8ad-4566-b8e2-34f0faef9e72 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf0fe9d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:47.002635 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07cc6d5c-e8ad-4566-b8e2-34f0faef9e72 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 200 len: 287 microversion: 2.1 time: 0.034940 Jun 18 08:13:47.003196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 443/875] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:46 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:47.013994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d3730a11-0154-4620-ad56-cb172d6b8923 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be41d98b0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:47.075350 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d3730a11-0154-4620-ad56-cb172d6b8923 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 202 len: 0 microversion: 2.1 time: 0.065336 Jun 18 08:13:47.076226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 433/876] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Jun 18 08:13:47 2022] DELETE /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:47.085420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-749b276a-f00d-4747-b5dc-394ae3c754c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf0ce4c0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:47.272851 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-749b276a-f00d-4747-b5dc-394ae3c754c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] HTTP exception thrown: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-749b276a-f00d-4747-b5dc-394ae3c754c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Request method failure captured: Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 HTTP/1.1 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYk145mp3O5P6aBQTCDiSa5H5RuyojRYppCNNhl-UDToTZrb_hJoABrxgimSiQXDYXuFHp2okjWQQSrM2x0QBy3oqNjKNXD_AqM2d7EjLm4XWlTYKTd-ZUdQ6Rrz3U3Ync9x4hmbG0JDFdSdJg_r1nGMDv_eJHC9glvIoHL4k3JaHW4 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:47.277615 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7f28cdc616384265b7d1db821d9af923", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: e7edc404443444208003701259f5f474 Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '55b916ee-3d4b-496e-a56e-7de3e4363841'} Jun 18 08:13:47.279125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. (HTTP 404) (Request-ID: req-6822d627-6a4e-496c-a52a-80b964f6db7a) Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.279967 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:47.281163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 18 08:13:47.282368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-749b276a-f00d-4747-b5dc-394ae3c754c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Returning 404 to user: Snapshot 55b916ee-3d4b-496e-a56e-7de3e4363841 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:47.283592 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-749b276a-f00d-4747-b5dc-394ae3c754c6 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841" status: 404 len: 111 microversion: 2.1 time: 0.197479 Jun 18 08:13:47.284412 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 444/877] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:13:47 2022] GET /compute/v2.1/os-snapshots/55b916ee-3d4b-496e-a56e-7de3e4363841 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:47.288763 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-618756f4-c85c-47c7-9272-38429374d369 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be4256040>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:47.370014 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-618756f4-c85c-47c7-9272-38429374d369 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 202 len: 0 microversion: 2.1 time: 0.085070 Jun 18 08:13:47.370592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 434/878] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:13:47 2022] DELETE /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:47.379292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bc15b4e5-c4b0-447b-9335-6e03a612f777 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf07f280>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:47.430451 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bc15b4e5-c4b0-447b-9335-6e03a612f777 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 200 len: 345 microversion: 2.1 time: 0.055072 Jun 18 08:13:47.431478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 445/879] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:47 2022] GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:48.445679 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-206c759b-88bb-47fc-a4eb-2b1d240b2a6c tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be42073a0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:48.475399 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-206c759b-88bb-47fc-a4eb-2b1d240b2a6c tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] HTTP exception thrown: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-206c759b-88bb-47fc-a4eb-2b1d240b2a6c tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Request method failure captured: Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 HTTP/1.1 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYk145mp3O5P6aBQTCDiSa5H5RuyojRYppCNNhl-UDToTZrb_hJoABrxgimSiQXDYXuFHp2okjWQQSrM2x0QBy3oqNjKNXD_AqM2d7EjLm4XWlTYKTd-ZUdQ6Rrz3U3Ync9x4hmbG0JDFdSdJg_r1nGMDv_eJHC9glvIoHL4k3JaHW4 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:48.478690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7f28cdc616384265b7d1db821d9af923", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: e7edc404443444208003701259f5f474 Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '7e8c5430-cd4c-49cb-adc6-26617f306e83'} Jun 18 08:13:48.480257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. (HTTP 404) (Request-ID: req-06cbb75c-ac7e-4d3b-85f9-cec226abd86a) Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.481213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:48.482605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 08:13:48.483882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-206c759b-88bb-47fc-a4eb-2b1d240b2a6c tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Returning 404 to user: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-206c759b-88bb-47fc-a4eb-2b1d240b2a6c tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 404 len: 109 microversion: 2.1 time: 0.039646 Jun 18 08:13:48.485453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 435/880] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:48 2022] GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:48.491121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4526e7c6-9812-479b-b71a-cde64bf3e411 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3bdf13a430>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:48.518934 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-4526e7c6-9812-479b-b71a-cde64bf3e411 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] HTTP exception thrown: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4526e7c6-9812-479b-b71a-cde64bf3e411 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Request method failure captured: Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 HTTP/1.1 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYk145mp3O5P6aBQTCDiSa5H5RuyojRYppCNNhl-UDToTZrb_hJoABrxgimSiQXDYXuFHp2okjWQQSrM2x0QBy3oqNjKNXD_AqM2d7EjLm4XWlTYKTd-ZUdQ6Rrz3U3Ync9x4hmbG0JDFdSdJg_r1nGMDv_eJHC9glvIoHL4k3JaHW4 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:48.521160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7f28cdc616384265b7d1db821d9af923", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: e7edc404443444208003701259f5f474 Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '7e8c5430-cd4c-49cb-adc6-26617f306e83'} Jun 18 08:13:48.522649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. (HTTP 404) (Request-ID: req-a125c2f0-9163-4081-add0-31b1c95eee9d) Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.523586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:48.524849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 08:13:48.526070 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4526e7c6-9812-479b-b71a-cde64bf3e411 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Returning 404 to user: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4526e7c6-9812-479b-b71a-cde64bf3e411 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 404 len: 109 microversion: 2.1 time: 0.035897 Jun 18 08:13:48.527440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 446/881] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:13:48 2022] DELETE /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:48.531345 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-837831e0-99bd-4a4a-8928-067d5a74e472 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Calling method '.version_select at 0x7f3be428bd30>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:48.559636 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-837831e0-99bd-4a4a-8928-067d5a74e472 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] HTTP exception thrown: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-837831e0-99bd-4a4a-8928-067d5a74e472 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Request method failure captured: Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 HTTP/1.1 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYk145mp3O5P6aBQTCDiSa5H5RuyojRYppCNNhl-UDToTZrb_hJoABrxgimSiQXDYXuFHp2okjWQQSrM2x0QBy3oqNjKNXD_AqM2d7EjLm4XWlTYKTd-ZUdQ6Rrz3U3Ync9x4hmbG0JDFdSdJg_r1nGMDv_eJHC9glvIoHL4k3JaHW4 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:48.561629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7f28cdc616384265b7d1db821d9af923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7f28cdc616384265b7d1db821d9af923", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7f28cdc616384265b7d1db821d9af923 Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-699706227 Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: e7edc404443444208003701259f5f474 Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-699706227-project Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '7e8c5430-cd4c-49cb-adc6-26617f306e83'} Jun 18 08:13:48.563185 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. (HTTP 404) (Request-ID: req-27e1e3a3-3e6c-47d9-9fca-c753cbf813f9) Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.564289 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:48.565629 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 08:13:48.566992 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-837831e0-99bd-4a4a-8928-067d5a74e472 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] Returning 404 to user: Volume 7e8c5430-cd4c-49cb-adc6-26617f306e83 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-837831e0-99bd-4a4a-8928-067d5a74e472 tempest-VolumesSnapshotsTestJSON-699706227 tempest-VolumesSnapshotsTestJSON-699706227-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83" status: 404 len: 109 microversion: 2.1 time: 0.035579 Jun 18 08:13:48.568353 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 436/882] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:48 2022] GET /compute/v2.1/os-volumes/7e8c5430-cd4c-49cb-adc6-26617f306e83 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:49.972027 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-78041d7a-4ca0-4f49-bace-a90784b4d600 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Action: 'create', calling method: .version_select at 0x7f3bdf07fe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1139112075", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:50.271961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-78041d7a-4ca0-4f49-bace-a90784b4d600 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.418145 Jun 18 08:13:50.272576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 447/883] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 08:13:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 18 08:13:50.284124 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f221381d-0b20-452f-b7e0-798f9eb9a9fb tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3be4177280>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:50.332422 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f221381d-0b20-452f-b7e0-798f9eb9a9fb tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 200 len: 353 microversion: 2.1 time: 0.051836 Jun 18 08:13:50.333059 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 437/884] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:50 2022] GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:51.349026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f10a41a-c478-45b5-93cd-55d167320dd7 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3bdf1220d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:51.404149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9f10a41a-c478-45b5-93cd-55d167320dd7 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 200 len: 354 microversion: 2.1 time: 0.061031 Jun 18 08:13:51.405025 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 448/885] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:51 2022] GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:51.417421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=45 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:51.418756 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=65 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:51.425916 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-02db564b-ce4c-455a-96af-f166ce03cb74 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3be427a5e0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:51.476312 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-02db564b-ce4c-455a-96af-f166ce03cb74 tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 200 len: 354 microversion: 2.1 time: 0.060176 Jun 18 08:13:51.476925 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 438/886] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:51 2022] GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:51.491724 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-62007be2-a166-4318-86d5-22a30518b0ed tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3bdf122430>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:51.564974 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-62007be2-a166-4318-86d5-22a30518b0ed tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 202 len: 0 microversion: 2.1 time: 0.077255 Jun 18 08:13:51.565644 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 449/887] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:13:51 2022] DELETE /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:13:51.574048 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50a69320-d468-40e2-8830-972c90cb9bca tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3be427ad30>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:51.623006 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50a69320-d468-40e2-8830-972c90cb9bca tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 200 len: 353 microversion: 2.1 time: 0.052845 Jun 18 08:13:51.623587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 439/888] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:51 2022] GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:13:52.634930 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:52.636472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:13:52.644008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6f19582e-6b9f-47d9-bb08-d15c1680603a tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Calling method '.version_select at 0x7f3bdf122040>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:52.675485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-6f19582e-6b9f-47d9-bb08-d15c1680603a tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] HTTP exception thrown: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6f19582e-6b9f-47d9-bb08-d15c1680603a tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Request method failure captured: Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa HTTP/1.1 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYk9jkvdWcvanOCGi42yyk6Rc5yqEzcjVjCIyQPg5NfwoHcPteS5JL-nPGGYbxiu95IwdjWq9k6e1c-ZxeJu-aSvu0g1_LIUgE6VCl0CeA5FmU1VFIbuGUO0CJ5kKAQssGdKcEuFgKwAVcSkQB4A0oGKSO8p7HrBNC9zR8sFabxG-VY Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 5ebf889fc55c4c8397aeaa4f30467ed2 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesGetTestJSON-405430572 Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:52.678499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ebf889fc55c4c8397aeaa4f30467ed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5ebf889fc55c4c8397aeaa4f30467ed2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ebf889fc55c4c8397aeaa4f30467ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5ebf889fc55c4c8397aeaa4f30467ed2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesGetTestJSON-405430572 Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 5ebf889fc55c4c8397aeaa4f30467ed2 Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesGetTestJSON-405430572 Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesGetTestJSON-405430572-project Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: b9b846cc2cb64b52a69a5b78af66268d Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesGetTestJSON-405430572-project Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'b3a5f43b-07ee-4297-9f69-775eac84d2fa'} Jun 18 08:13:52.680021 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. (HTTP 404) (Request-ID: req-79e00acf-1637-4461-9e80-ef64d7b03029) Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:52.681319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:52.682794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 08:13:52.684160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6f19582e-6b9f-47d9-bb08-d15c1680603a tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] Returning 404 to user: Volume b3a5f43b-07ee-4297-9f69-775eac84d2fa could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6f19582e-6b9f-47d9-bb08-d15c1680603a tempest-VolumesGetTestJSON-405430572 tempest-VolumesGetTestJSON-405430572-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa" status: 404 len: 109 microversion: 2.1 time: 0.046829 Jun 18 08:13:52.685595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 450/889] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:52 2022] GET /compute/v2.1/os-volumes/b3a5f43b-07ee-4297-9f69-775eac84d2fa => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:54.138305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b49b177d-a12d-44e9-90f6-234c149d6889 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Action: 'create', calling method: .version_select at 0x7f3be42e3940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254465474", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b49b177d-a12d-44e9-90f6-234c149d6889 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 122 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:54.176206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254465474", "metadata": {"Type": "work"}}} Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: Jun 18 08:13:54.178469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1254465474', 'metadata': {'Type': 'work'}}}} Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise error Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi '#$%' Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.179561 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 08:13:54.181483 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 08:13:54.182680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 08:13:54.182680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.182680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b49b177d-a12d-44e9-90f6-234c149d6889 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.182680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b49b177d-a12d-44e9-90f6-234c149d6889 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172295 Jun 18 08:13:54.182680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 440/890] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 08:13:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:13:54.188708 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fefb6635-757d-4d10-9bc0-846309b31557 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Action: 'create', calling method: .version_select at 0x7f3bdf07ff70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1964149100", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fefb6635-757d-4d10-9bc0-846309b31557 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 120 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:54.192013 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1964149100", "metadata": {"Type": "work"}}} Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:54.193628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1964149100', 'metadata': {'Type': 'work'}}}} Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise error Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi '0' Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.194768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 08:13:54.196356 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 08:13:54.197800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 08:13:54.197800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.197800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fefb6635-757d-4d10-9bc0-846309b31557 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.197800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fefb6635-757d-4d10-9bc0-846309b31557 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008979 Jun 18 08:13:54.197800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 451/891] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 08:13:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:13:54.203465 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d22da7f-6ee1-4db8-88e1-adeb151230b0 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Action: 'create', calling method: .version_select at 0x7f3be4327d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-558258005", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d22da7f-6ee1-4db8-88e1-adeb151230b0 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 118 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:54.205841 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-558258005", "metadata": {"Type": "work"}}} Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: Jun 18 08:13:54.207447 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-558258005', 'metadata': {'Type': 'work'}}}} Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise error Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi '' Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.208382 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 08:13:54.209975 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 08:13:54.211417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 08:13:54.211417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.211417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d22da7f-6ee1-4db8-88e1-adeb151230b0 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.211417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d22da7f-6ee1-4db8-88e1-adeb151230b0 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007892 Jun 18 08:13:54.211417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 441/892] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Jun 18 08:13:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:13:54.216977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cbb15b56-c067-47be-8422-c02f87355975 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Calling method '.version_select at 0x7f3bdf07f5e0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:54.245651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-cbb15b56-c067-47be-8422-c02f87355975 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] HTTP exception thrown: Volume tempest-invalid-1007277623 could not be found. Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cbb15b56-c067-47be-8422-c02f87355975 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1007277623 HTTP/1.1 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:54.247786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Volume tempest-invalid-1007277623 could not be found. Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'tempest-invalid-1007277623'} Jun 18 08:13:54.249333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1007277623 could not be found. (HTTP 404) (Request-ID: req-f380c0b5-d280-4cee-831f-ad79c5fcd143) Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.250297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:54.251653 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1007277623 could not be found. Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:54.252976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1007277623 could not be found. Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1007277623 could not be found. Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cbb15b56-c067-47be-8422-c02f87355975 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 404 to user: Volume tempest-invalid-1007277623 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cbb15b56-c067-47be-8422-c02f87355975 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1007277623" status: 404 len: 99 microversion: 2.1 time: 0.036663 Jun 18 08:13:54.254384 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 452/893] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Jun 18 08:13:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1007277623 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 08:13:54.259792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb396b2f-0cdb-4ec7-b521-5b263662d9e7 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003839 Jun 18 08:13:54.260286 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 442/894] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Jun 18 08:13:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 08:13:54.268503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-22b4946b-5c08-4565-9e1d-ec5298d4d687 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003657 Jun 18 08:13:54.268952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 453/895] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Jun 18 08:13:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 08:13:54.276904 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e63e7d0a-20ed-42c5-ac40-1e000ea5899d tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Calling method '.version_select at 0x7f3be4200b80>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:54.305219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-e63e7d0a-20ed-42c5-ac40-1e000ea5899d tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] HTTP exception thrown: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e63e7d0a-20ed-42c5-ac40-1e000ea5899d tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/os-volumes/ce051ddd-40b4-4700-9242-fd99b881ba77 HTTP/1.1 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:13:54.307610 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'ce051ddd-40b4-4700-9242-fd99b881ba77'} Jun 18 08:13:54.309259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. (HTTP 404) (Request-ID: req-cf6d4dc8-ef2e-445a-b344-e1b36b7d323d) Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.310182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 08:13:54.311595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 08:13:54.313019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e63e7d0a-20ed-42c5-ac40-1e000ea5899d tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 404 to user: Volume ce051ddd-40b4-4700-9242-fd99b881ba77 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e63e7d0a-20ed-42c5-ac40-1e000ea5899d tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ce051ddd-40b4-4700-9242-fd99b881ba77" status: 404 len: 109 microversion: 2.1 time: 0.035470 Jun 18 08:13:54.314394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 443/896] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:13:54 2022] DELETE /compute/v2.1/os-volumes/ce051ddd-40b4-4700-9242-fd99b881ba77 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:13:54.318439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88b630b9-d0ee-4deb-9f48-652d0fa48728 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Calling method '.version_select at 0x7f3bdf1220d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:13:54.349972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-88b630b9-d0ee-4deb-9f48-652d0fa48728 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] HTTP exception thrown: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88b630b9-d0ee-4deb-9f48-652d0fa48728 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Request method failure captured: Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/9f827661-7ec1-4558-b9cd-0adbcb5cd53e HTTP/1.1 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYlBXG5p5Nae3pFYA4g3VAzW5Sb9HjRHLLLsS49cGN_62Xq5HiyxNOCOzq4LSDcz5O9-d7WdaFScdYr5z4RPcR6AndmV4JKX9_vkM4a1VH5Frmn5o9KWZXyIGFFBcfBF6i3Zx0Xr_Qr5KY2jR1cl5WwSLBcnctMq9uPi3Q5DdThKpEY Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:13:54.352456 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94674ea607494d388ff382a014811d25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94674ea607494d388ff382a014811d25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94674ea607494d388ff382a014811d25", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 94674ea607494d388ff382a014811d25 Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-206033643 Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 028eb22c95df4f75b7601a7246025b06 Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-206033643-project Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '9f827661-7ec1-4558-b9cd-0adbcb5cd53e'} Jun 18 08:13:54.354053 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. (HTTP 404) (Request-ID: req-626842f6-8852-4116-8a9a-0257197c307f) Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.360226 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 08:13:54.361590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 08:13:54.363064 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88b630b9-d0ee-4deb-9f48-652d0fa48728 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] Returning 404 to user: Volume 9f827661-7ec1-4558-b9cd-0adbcb5cd53e could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-88b630b9-d0ee-4deb-9f48-652d0fa48728 tempest-VolumesNegativeTest-206033643 tempest-VolumesNegativeTest-206033643-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/9f827661-7ec1-4558-b9cd-0adbcb5cd53e" status: 404 len: 109 microversion: 2.1 time: 0.039167 Jun 18 08:13:54.364386 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 454/897] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Jun 18 08:13:54 2022] GET /compute/v2.1/os-volumes/9f827661-7ec1-4558-b9cd-0adbcb5cd53e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:10.613106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:10.614023 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:10.627881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.628324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.629101 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.629535 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.657553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bfac5d40-77bd-4630-beef-7f4040b8c793 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049187 Jun 18 08:14:10.658103 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 444/898] 10.222.0.23 () {60 vars in 1342 bytes} [Sat Jun 18 08:14:10 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:14:10.716562 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:10.717163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:10.723469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.723942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.724693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.725113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.749936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:14:10.827275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4b0a1a0c-95c7-487b-9d4b-14d6f0dab1b2 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 204 len: 0 microversion: 2.20 time: 0.115393 Jun 18 08:14:10.828155 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 455/899] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 08:14:10 2022] DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 08:14:10.836779 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:10.837480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:10.843928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.844847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.845630 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:10.846133 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:10.980999 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:10.989083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:10.990662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:10.991860 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-30272550-0491-40ed-b746-e1f87b91318e tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.159567 Jun 18 08:14:10.992415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 445/900] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:10 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:14:12.010110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:12.010802 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:12.017244 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:12.017693 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:12.018452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:12.018888 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:12.149963 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:12.158865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:12.160466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:12.162029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f71da1e9-a95a-463d-9aae-0cbcd0523f6a tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1724 microversion: 2.20 time: 0.156268 Jun 18 08:14:12.162593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 456/901] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:12 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 08:14:13.180704 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:13.181343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:13.188273 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d733a2d1-42cd-47a4-b161-e8466e059ec1 req-cb1724d6-9cc9-4906-885a-c391741bc5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f096-17fd-4698-b185-6ff22ddb8826", "name": "network-vif-deleted", "tag": "27173a71-a8ce-4f90-b96d-795c56228474"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:14:13.192484 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:13.193163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:13.194168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:13.194582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:13.198637 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d733a2d1-42cd-47a4-b161-e8466e059ec1 req-cb1724d6-9cc9-4906-885a-c391741bc5bb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:13.199104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d733a2d1-42cd-47a4-b161-e8466e059ec1 req-cb1724d6-9cc9-4906-885a-c391741bc5bb service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:13.219396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d733a2d1-42cd-47a4-b161-e8466e059ec1 req-cb1724d6-9cc9-4906-885a-c391741bc5bb service nova] Creating event network-vif-deleted:27173a71-a8ce-4f90-b96d-795c56228474 for instance bd41f096-17fd-4698-b185-6ff22ddb8826 on hv-cinder-82634 Jun 18 08:14:13.235149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d733a2d1-42cd-47a4-b161-e8466e059ec1 req-cb1724d6-9cc9-4906-885a-c391741bc5bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050753 Jun 18 08:14:13.237011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 457/902] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:14:13.282745 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:13.292958 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:13.294619 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39cd1520458f49df9ff4edb63c09f746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9abdfe8063473abfa91f578081eb0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:13.296812 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4c542889-65d5-480d-8b76-15cd0fc6fbf4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 200 len: 1656 microversion: 2.20 time: 0.120346 Jun 18 08:14:13.297624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 446/903] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:13 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 1656 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 08:14:14.317130 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:14.317664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:14.324583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:14.325029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:14.325792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:14.326220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:14.339611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 HTTP/1.1 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:14.341275 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:14.342765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'bd41f096-17fd-4698-b185-6ff22ddb8826'} Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:14.343575 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:14.344864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:14.346108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:14.346108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-687fe9a6-9c4c-4658-bd63-0f06190f6985 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 404 len: 111 microversion: 2.20 time: 0.030720 Jun 18 08:14:14.346108 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 458/904] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:14 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:14:14.351993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-42ee3cb1-9686-469c-af02-0681f6ded1b4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '.version_select at 0x7f3be428b790>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:14.372005 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-42ee3cb1-9686-469c-af02-0681f6ded1b4 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012300379" status: 204 len: 0 microversion: 2.20 time: 0.024017 Jun 18 08:14:14.372685 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 447/905] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Jun 18 08:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012300379 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 08:14:16.129677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:16.130289 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:16.137069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:16.137501 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:16.138694 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:16.139046 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:16.152619 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 HTTP/1.1 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:16.154205 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.155843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'bd41f096-17fd-4698-b185-6ff22ddb8826'} Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:16.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.157948 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.164781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:16.164781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-48677ea0-1b9f-4e91-9fe9-a03e3d101464 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 404 len: 111 microversion: 2.20 time: 0.030249 Jun 18 08:14:16.164781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 459/906] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 08:14:16 2022] DELETE /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:14:16.166010 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:16.166617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: bd41f096-17fd-4698-b185-6ff22ddb8826] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:16.173304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:16.173748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:16.174509 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:16.174934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:16.188397 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 HTTP/1.1 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:16.189989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.191544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'bd41f096-17fd-4698-b185-6ff22ddb8826'} Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:16.192305 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. Jun 18 08:14:16.193614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:16.194707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance bd41f096-17fd-4698-b185-6ff22ddb8826 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:16.194707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-106b107c-8247-4cae-82d8-5c45fa9eb1fd tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826" status: 404 len: 111 microversion: 2.20 time: 0.030786 Jun 18 08:14:16.194707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 448/907] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:16 2022] GET /compute/v2.1/servers/bd41f096-17fd-4698-b185-6ff22ddb8826 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:14:17.343387 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:17.343913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:17.351212 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.351649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.352400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.352886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.366849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 HTTP/1.1 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:17.368458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.370011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ab6e7d6f-1ab3-489b-938f-60eed0962e00'} Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:17.370846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.372220 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.373420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:17.373420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-999fad76-d21c-46fd-952e-141b9b6dda4f tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 404 len: 111 microversion: 2.20 time: 0.030572 Jun 18 08:14:17.373420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 460/908] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Jun 18 08:14:17 2022] DELETE /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:14:17.378490 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:17.379119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] [instance: ab6e7d6f-1ab3-489b-938f-60eed0962e00] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:17.385899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.386351 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.387148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.387582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.400884 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] HTTP exception thrown: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Request method failure captured: Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 HTTP/1.1 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYensdYCBx4qZTmjiNbmQ4e0UI7bwYEnqSrOCBib1wsGRfh2cA8D2MzzobrGRmw0NdoE20dvwQD_WU-dsidj_oURrlgTqsISZbOGj4GWRNVxBkzTh6OfZgU11svxR2v9kf-8LWuGXpJUw3sQuD1FjMQxaz15O9WOx4hpkGmAKuh2or4 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:17.402438 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9abdfe8063473abfa91f578081eb0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9abdfe8063473abfa91f578081eb0d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fc9abdfe8063473abfa91f578081eb0d Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1333962766 Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 39cd1520458f49df9ff4edb63c09f746 Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1333962766-project Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.404065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'ab6e7d6f-1ab3-489b-938f-60eed0962e00'} Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:17.404801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. Jun 18 08:14:17.405997 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:17.407294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] Returning 404 to user: Instance ab6e7d6f-1ab3-489b-938f-60eed0962e00 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:17.407294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a542478-6dee-4a52-b1e2-6ec85bf6d4b0 tempest-AttachVolumeShelveTestJSON-1333962766 tempest-AttachVolumeShelveTestJSON-1333962766-project] 10.222.0.23 "GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00" status: 404 len: 111 microversion: 2.20 time: 0.030237 Jun 18 08:14:17.407294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 449/909] 10.222.0.23 () {60 vars in 1276 bytes} [Sat Jun 18 08:14:17 2022] GET /compute/v2.1/servers/ab6e7d6f-1ab3-489b-938f-60eed0962e00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 08:14:17.719122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:17.719700 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:17.726193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.726970 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.727826 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:17.728484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:17.751830 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-06c00c37-ebea-4f95-92d4-92d10a652ddf tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/ips" status: 200 len: 149 microversion: 2.1 time: 0.036581 Jun 18 08:14:17.752763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 461/910] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Jun 18 08:14:17 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:14:19.137167 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f1a1f2a-9929-42e8-a84b-9f3f157ada3c"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:14:19.139233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:19.146712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:19.147450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:19.148374 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:19.148971 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:19.491880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-20e3ff36-6e14-401d-b2d4-9d9596e20740 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "POST /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359296 Jun 18 08:14:19.493343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 450/911] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:14:19 2022] POST /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:14:28.272030 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:28.272598 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:28.275182 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:14:28.275827 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:14:28.280924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:28.281364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:28.282141 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:28.282905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:28.382297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lazy-loading 'services' on Instance uuid 8b7845c8-de84-492a-8057-bb824810e9a1 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:14:28.457201 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f25bf3f8-bccd-4671-8425-83dae9f488e9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments/0f1a1f2a-9929-42e8-a84b-9f3f157ada3c" status: 202 len: 0 microversion: 2.1 time: 0.188987 Jun 18 08:14:28.457774 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 462/912] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:14:28 2022] DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments/0f1a1f2a-9929-42e8-a84b-9f3f157ada3c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:14:28.467450 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:28.468551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:28.474797 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:28.475399 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:28.476163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:28.476593 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:28.506805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9b380d34-318a-4af7-81bf-fc31de453535 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Jun 18 08:14:28.507376 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 451/913] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:14:28 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:14:29.521913 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:29.522984 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:29.529847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:29.530288 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:29.531047 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:29.531513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:29.561624 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0ea4594c-f39e-4440-87ee-a6ba2b3177f1 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Jun 18 08:14:29.562178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 463/914] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:14:29 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:14:30.574427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:30.576318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:30.583566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:30.584138 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:30.584783 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:30.585195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:30.617592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e8540b5e-7e5f-4f40-b1b2-7182ed801a21 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047391 Jun 18 08:14:30.618469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 452/915] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:14:30 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:14:31.635425 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:31.636899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:31.647682 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.648119 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:31.648875 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.649302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:31.677946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2d68593-6aa1-4da7-ba13-2967b5e706e3 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050855 Jun 18 08:14:31.678685 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 464/916] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:14:31 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:14:31.741202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:31.741787 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:31.750104 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.750730 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:31.751994 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.752626 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:31.788235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:14:31.880968 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-53888280-a73a-4817-89e9-25162b367a30 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 204 len: 0 microversion: 2.1 time: 0.146047 Jun 18 08:14:31.881662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 453/917] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:14:31 2022] DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:14:31.891400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:31.892078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:31.898142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.898580 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:31.899385 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:31.899811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:32.038443 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:32.046257 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb004b26-4a72-4f5e-a1db-c8f4b56ee02f tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1680 microversion: 2.1 time: 0.158801 Jun 18 08:14:32.046812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 465/918] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:31 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:14:33.063922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:33.064520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:33.071571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:33.072019 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:33.072818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:33.073248 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:33.213400 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:33.224847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-caef033e-9e61-45d2-989b-1a3c5f36456d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1680 microversion: 2.1 time: 0.165125 Jun 18 08:14:33.225684 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 454/919] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:33 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:14:34.246364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:34.247366 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:34.257803 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:34.258243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:34.258991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:34.259454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:34.391524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:34.400974 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e65c10fa-6825-404a-b159-0ca3afb2d907 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1680 microversion: 2.1 time: 0.161011 Jun 18 08:14:34.401542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 466/920] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:34 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:14:35.419477 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:35.420120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:35.427572 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:35.428037 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:35.428794 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:35.429227 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:35.571407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:35.579296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d8bfbbc8-6d1a-4b75-9014-0c1d364608e0 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1680 microversion: 2.1 time: 0.163861 Jun 18 08:14:35.579869 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 455/921] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:35 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:14:36.597131 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:36.598093 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:36.606485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:36.606895 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:36.607991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:36.608512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:36.688814 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc7cd82812d741258ed729bf5b218567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8f4ea5f647f4006a87f41f366772afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:14:36.697304 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-10ed6874-2437-48d3-ae90-0729b879d7a5 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 200 len: 1613 microversion: 2.1 time: 0.104442 Jun 18 08:14:36.697882 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 467/922] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:36 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:14:36.724225 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2f9ae50e-7dd5-49a7-b328-fabf475315da req-6c34124f-f412-451d-bb6c-d75cd0d78500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7845c8-de84-492a-8057-bb824810e9a1", "name": "network-vif-deleted", "tag": "d73ec793-19cc-491b-af74-11b58248cf9a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:14:36.733199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f9ae50e-7dd5-49a7-b328-fabf475315da req-6c34124f-f412-451d-bb6c-d75cd0d78500 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:36.733640 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f9ae50e-7dd5-49a7-b328-fabf475315da req-6c34124f-f412-451d-bb6c-d75cd0d78500 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:36.744986 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2f9ae50e-7dd5-49a7-b328-fabf475315da req-6c34124f-f412-451d-bb6c-d75cd0d78500 service nova] Creating event network-vif-deleted:d73ec793-19cc-491b-af74-11b58248cf9a for instance 8b7845c8-de84-492a-8057-bb824810e9a1 on hv-cinder-82634 Jun 18 08:14:36.749875 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2f9ae50e-7dd5-49a7-b328-fabf475315da req-6c34124f-f412-451d-bb6c-d75cd0d78500 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Jun 18 08:14:36.750617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 456/923] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:14:37.715834 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:37.718513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:37.730457 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:37.731232 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:37.732009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:37.732437 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:37.748372 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 HTTP/1.1 Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:37.750490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:37.752190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '8b7845c8-de84-492a-8057-bb824810e9a1'} Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:37.753148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:37.754660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:37.758917 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:37.759988 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-724c0a58-4e0e-4724-a4f2-b48c6bbafa1c tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 404 len: 111 microversion: 2.1 time: 0.048835 Jun 18 08:14:37.760549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 468/924] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:37 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:37.769923 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d03fcba1-0b55-4664-9352-146612518acd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '.version_select at 0x7f3be42e35e0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:37.790195 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d03fcba1-0b55-4664-9352-146612518acd tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107021071" status: 202 len: 0 microversion: 2.1 time: 0.024511 Jun 18 08:14:37.792003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 457/925] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Jun 18 08:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107021071 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:14:39.600714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:39.601262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:39.608245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:39.608685 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:39.609435 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:39.609859 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:39.623368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 HTTP/1.1 Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:39.624896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.626453 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '8b7845c8-de84-492a-8057-bb824810e9a1'} Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:39.627344 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.628568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.630112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:39.630112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dee68e34-88db-4098-9d1a-786c8e50efe9 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 404 len: 111 microversion: 2.1 time: 0.029545 Jun 18 08:14:39.630112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 469/926] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:14:39 2022] DELETE /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:39.635414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:39.636142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 8b7845c8-de84-492a-8057-bb824810e9a1] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:39.643292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:39.643743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:39.644510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:39.644948 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:39.658541 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 HTTP/1.1 Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:39.660202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.661826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '8b7845c8-de84-492a-8057-bb824810e9a1'} Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:39.662710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. Jun 18 08:14:39.664281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:39.665598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 8b7845c8-de84-492a-8057-bb824810e9a1 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:39.665598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d9df916-3f9c-4e2e-bc1c-5b04542f504d tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jun 18 08:14:39.665598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 458/927] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:39 2022] GET /compute/v2.1/servers/8b7845c8-de84-492a-8057-bb824810e9a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:40.812660 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:40.813181 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:40.820138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.820593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.821348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.821780 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.835498 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f HTTP/1.1 Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:40.837164 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.838728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '4d0db5b5-f762-45a3-9c16-d43416d4ed1f'} Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:40.839670 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.841209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.842683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:40.842683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-53031e76-8b1f-4c41-ba8e-95a42115fa39 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 404 len: 111 microversion: 2.1 time: 0.029853 Jun 18 08:14:40.842683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 470/928] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:14:40 2022] DELETE /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:40.849002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:40.849687 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 4d0db5b5-f762-45a3-9c16-d43416d4ed1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:40.853239 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:14:40.860398 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.860974 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.862028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.862566 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.867134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:14:40.881855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f HTTP/1.1 Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:40.883421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.885001 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '4d0db5b5-f762-45a3-9c16-d43416d4ed1f'} Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:40.887283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. Jun 18 08:14:40.890403 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.892563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 4d0db5b5-f762-45a3-9c16-d43416d4ed1f could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:40.892563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-95bc7dc8-374e-49d1-8f28-6912c0b6dd07 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f" status: 404 len: 111 microversion: 2.1 time: 0.041824 Jun 18 08:14:40.892563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 459/929] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:40 2022] GET /compute/v2.1/servers/4d0db5b5-f762-45a3-9c16-d43416d4ed1f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:40.894293 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:40.894794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:40.904016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.904466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.905234 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.905664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.920033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd HTTP/1.1 Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:40.921583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.923160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '5f253692-d1ff-49e3-8583-70666337a4cd'} Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:40.924092 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.925464 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.926972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:40.926972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e70757f3-9083-4e49-add2-23fd259e85b7 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 404 len: 111 microversion: 2.1 time: 0.032660 Jun 18 08:14:40.926972 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 471/930] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:14:40 2022] DELETE /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 08:14:40.932193 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:40.932809 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: 5f253692-d1ff-49e3-8583-70666337a4cd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:40.940144 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.940589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.941355 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:40.941788 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:40.955475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd HTTP/1.1 Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:40.956998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.958558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '5f253692-d1ff-49e3-8583-70666337a4cd'} Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:40.959458 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. Jun 18 08:14:40.961015 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:40.962584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance 5f253692-d1ff-49e3-8583-70666337a4cd could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:40.962584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0125743e-020e-4737-9fae-b613645c9570 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd" status: 404 len: 111 microversion: 2.1 time: 0.030610 Jun 18 08:14:40.962584 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 460/931] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:40 2022] GET /compute/v2.1/servers/5f253692-d1ff-49e3-8583-70666337a4cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:42.109281 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:42.109822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:42.116940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:42.117408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:42.118174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:42.118600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:42.133524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 HTTP/1.1 Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:14:42.135431 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.137063 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'b729a844-3a58-4b1a-9d49-bb4aa97773e6'} Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:42.137982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.139423 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.140879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:42.140879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3dc078ea-668b-4510-9890-28e508946b8a tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 404 len: 111 microversion: 2.1 time: 0.031409 Jun 18 08:14:42.140879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 472/932] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:14:42 2022] DELETE /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:14:42.147948 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:14:42.148675 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] [instance: b729a844-3a58-4b1a-9d49-bb4aa97773e6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:14:42.155480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:42.155930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:42.156691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:14:42.157121 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:14:42.170991 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] HTTP exception thrown: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Request method failure captured: Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 HTTP/1.1 Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYfwglwBVyRHCsa1WMcwV6wgHVtpCRKy18AjcA8XYv0NE8vLEF-HCyorDVOXB1vBY_LxpSN_xm7SrxcVEjbhAP6J-9LfdHxITqp_F-ZFa1_hIDtK4zRqFPh9fybuSC1Z2QRjygGte-xjHieKfHxbvhnH7GDKunKexSlZPcvxnljEKoA Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:14:42.172587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f4ea5f647f4006a87f41f366772afa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f4ea5f647f4006a87f41f366772afa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c8f4ea5f647f4006a87f41f366772afa Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-20332761 Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: bc7cd82812d741258ed729bf5b218567 Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-20332761-project Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.174172 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'b729a844-3a58-4b1a-9d49-bb4aa97773e6'} Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:14:42.174998 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. Jun 18 08:14:42.176254 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:14:42.177314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] Returning 404 to user: Instance b729a844-3a58-4b1a-9d49-bb4aa97773e6 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:14:42.177314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba81a479-3142-4c73-8fd7-c215e4089350 tempest-AttachVolumeNegativeTest-20332761 tempest-AttachVolumeNegativeTest-20332761-project] 10.222.0.23 "GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6" status: 404 len: 111 microversion: 2.1 time: 0.032480 Jun 18 08:14:42.177314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 461/933] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:14:42 2022] GET /compute/v2.1/servers/b729a844-3a58-4b1a-9d49-bb4aa97773e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 08:15:48.008421 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=22 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:48.009402 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:48.320729 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb5075b3-7b6d-4907-912d-ac1c62153e5f tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Action: 'create', calling method: .version_select at 0x7f3bdf0fe700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1725692452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbJzD6tHZjq9HIjXNUvRFCwr6yh2jD2dDMzfSzNo7ZHuiMUwuDbt0hE7n/I/hnIAuYb4XHZAbyugOxs0uicLd/lg4iYw/RtJdNQTdvnNz4xbvXmqUr43d7nq7s6C2t5NA=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:15:48.335705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eb5075b3-7b6d-4907-912d-ac1c62153e5f tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for project 49e317feb48548bba0745b2297130f5e. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:15:48.340141 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eb5075b3-7b6d-4907-912d-ac1c62153e5f tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for user 1e35908c10cc4627a655a283cc60c128 and project 49e317feb48548bba0745b2297130f5e. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:15:48.366287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb5075b3-7b6d-4907-912d-ac1c62153e5f tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.360057 Jun 18 08:15:48.366814 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 473/934] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:15:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:15:58.988120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=5 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:58.988865 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=5 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:58.995457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6cbab791-7690-47de-b67a-830f11a20ab7 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'create', calling method: .version_select at 0x7f3be42e3820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2050283830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWRfIVzSy1FO3NLjaZOAd2IpcpLFYgbZ78Y/eckHvQV2XDfk0mHxa5FPbHGMJJbc8zTa7X0KSGA7Nh5vz45chwjEwlynoDc9sQT/K6t0fmuf3leO+phuRT23mujLA3tHQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:15:59.013641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6cbab791-7690-47de-b67a-830f11a20ab7 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Getting quotas for project ea8b2e1c7f6d4e10b9bc871803dfcf0e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:15:59.018303 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6cbab791-7690-47de-b67a-830f11a20ab7 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Getting quotas for user 2f44bfdb4cef4d87845b53bccee17a83 and project ea8b2e1c7f6d4e10b9bc871803dfcf0e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:15:59.048537 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6cbab791-7690-47de-b67a-830f11a20ab7 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062231 Jun 18 08:15:59.049653 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 462/935] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:15:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:15:59.153683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:59.154497 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:15:59.158831 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1358990807", "imageRef": "6910f74d-a4d8-473a-8ca6-59c0e44af6ff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2050283830", "networks": [{"uuid": "2bb342f6-a702-4152-8ef4-fae521e105b2"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:15:59.211652 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] validate_networks() for [('2bb342f6-a702-4152-8ef4-fae521e105b2', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:15:59.600299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:15:59.600781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:15:59.601379 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:15:59.601843 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:15:59.602330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:15:59.611969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:15:59.612473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:15:59.613348 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:15:59.613840 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:15:59.630450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Getting quotas for project ea8b2e1c7f6d4e10b9bc871803dfcf0e. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:15:59.634632 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Getting quotas for user 2f44bfdb4cef4d87845b53bccee17a83 and project ea8b2e1c7f6d4e10b9bc871803dfcf0e. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:15:59.645827 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:15:59.648222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6910f74d-a4d8-473a-8ca6-59c0e44af6ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:15:59.692871 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f1e62cb-e765-4d37-bcbb-9ac8397cd8dd tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540508 Jun 18 08:15:59.693505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 474/936] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:15:59.704147 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5f429660-643e-4511-b37e-e68520107ff3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:15:59.704766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5f429660-643e-4511-b37e-e68520107ff3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:15:59.760712 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5f429660-643e-4511-b37e-e68520107ff3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:15:59.767576 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5f429660-643e-4511-b37e-e68520107ff3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1259 microversion: 2.1 time: 0.067533 Jun 18 08:15:59.768130 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 463/937] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:15:59 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:00.784975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:00.785564 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:00.793104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:00.793549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:00.794307 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:00.794734 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:00.858016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:00.865883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-100c858a-a771-4dd3-a314-023995fbdded tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1311 microversion: 2.1 time: 0.085368 Jun 18 08:16:00.866590 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 475/938] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:00 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:01.884074 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:01.885331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:01.899338 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:01.899791 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:01.900587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:01.901021 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:02.134003 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:02.158128 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f1404e0e-58ad-4fe3-a17f-e00295fc3027 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.278239 Jun 18 08:16:02.159342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 464/939] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:01 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:03.176352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:03.177400 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:03.184284 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:03.184729 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:03.185557 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:03.186040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:03.344328 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:03.352010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6552bbe6-3452-469e-90bb-2b28e29e4869 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.179630 Jun 18 08:16:03.352591 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 476/940] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:03 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:04.320881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1987579934", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1725692452", "security_groups": [{"name": "tempest-secgroup-smoke-405259699"}], "block_device_mapping_v2": [{"uuid": "303f9ae6-3182-41fc-a0cc-306818c4f06a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05510254-5856-414b-a3c7-167e95f14eac"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:04.369857 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:04.370472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:04.377727 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:04.378244 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:04.379172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:04.379838 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:04.451238 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] validate_networks() for [('05510254-5856-414b-a3c7-167e95f14eac', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:16:04.533776 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:04.549712 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ce3cfb79-ed0b-404b-9259-419760d91003 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.182859 Jun 18 08:16:04.551004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 477/941] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:04 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:16:04.957653 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:16:04.958537 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:16:04.959221 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:16:04.959808 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:16:04.960570 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:16:04.970611 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:04.971085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:04.972055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:04.972670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:04.989694 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:16:04.993827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for user 1e35908c10cc4627a655a283cc60c128 and project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:16:05.058467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:16:05.060725 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='303f9ae6-3182-41fc-a0cc-306818c4f06a',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:16:05.204123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b576be1a-a514-492c-8614-1ad66da4fde8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.887153 Jun 18 08:16:05.205145 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 465/942] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:16:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:16:05.215591 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5eb692c7-6c5f-4f63-99f0-37aa4584cc10 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:05.216572 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5eb692c7-6c5f-4f63-99f0-37aa4584cc10 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:05.278547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5eb692c7-6c5f-4f63-99f0-37aa4584cc10 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:05.286128 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5eb692c7-6c5f-4f63-99f0-37aa4584cc10 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1095 microversion: 2.1 time: 0.075037 Jun 18 08:16:05.287549 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 478/943] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:05 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:05.569068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:05.570449 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:05.578064 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:05.578592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:05.579743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:05.580383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:05.753340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:05.760909 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a6fe3ece-cfdf-493c-b137-2d0c4d9d5e78 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.196827 Jun 18 08:16:05.761475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 466/944] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:05 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:06.304921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:06.305539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:06.313284 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:06.314110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:06.315276 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:06.315940 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:06.378891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:06.387169 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e0e76d3-4f2f-4a33-8ba6-e8bd583c9a51 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1145 microversion: 2.1 time: 0.086900 Jun 18 08:16:06.387741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 479/945] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:06 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:06.778008 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:06.778622 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:06.785282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:06.785722 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:06.786479 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:06.786906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:06.924531 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:06.933839 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d09d68c0-97ff-44f6-9c1a-3438d72e8224 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.159714 Jun 18 08:16:06.934417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 467/946] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:06 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:16:07.404369 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:07.405096 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:07.412956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:07.413503 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:07.414351 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:07.414812 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:07.481466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:07.491579 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e570ec5-06b6-48b5-93ff-149b47c8be7c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1145 microversion: 2.1 time: 0.091208 Jun 18 08:16:07.492539 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 480/947] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:07 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:07.951659 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:07.953088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:07.960368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:07.960919 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:07.961703 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:07.962196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:08.110532 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:08.118453 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-46f0bc4e-d327-4a42-bc1c-8ffc0c9abff4 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.170687 Jun 18 08:16:08.119190 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 468/948] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:07 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:16:08.513100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:08.514595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:08.521979 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:08.522537 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:08.523350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:08.523777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:08.588938 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:08.596983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ecbb7210-d481-4e5e-b5bd-8117c7ea83c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1145 microversion: 2.1 time: 0.089237 Jun 18 08:16:08.597805 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 481/949] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:08 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:09.139719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:09.140676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:09.151119 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:09.151567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:09.152325 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:09.152751 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:09.296140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:09.305211 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4167a3dd-805a-48d4-a851-341351099926 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.171933 Jun 18 08:16:09.305917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 469/950] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:09 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:09.613894 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:09.614465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:09.621330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:09.621766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:09.622517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:09.622901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:09.623601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:09.695977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:09.704171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5e019733-2b04-47aa-85b2-0816e95fbe2b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1137 microversion: 2.1 time: 0.094134 Jun 18 08:16:09.704792 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 482/951] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:09 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:09.977607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5bc63e5e-885f-4d73-a093-c33d28c4a44d req-7d20d294-8707-49d0-aa1d-c91bf5cdf178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:09.987173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5bc63e5e-885f-4d73-a093-c33d28c4a44d req-7d20d294-8707-49d0-aa1d-c91bf5cdf178 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:09.987689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5bc63e5e-885f-4d73-a093-c33d28c4a44d req-7d20d294-8707-49d0-aa1d-c91bf5cdf178 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:10.000667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5bc63e5e-885f-4d73-a093-c33d28c4a44d req-7d20d294-8707-49d0-aa1d-c91bf5cdf178 service nova] Creating event network-changed:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:16:10.007318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5bc63e5e-885f-4d73-a093-c33d28c4a44d req-7d20d294-8707-49d0-aa1d-c91bf5cdf178 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Jun 18 08:16:10.007932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 470/952] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:10.322281 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:10.323049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:10.329317 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:10.329743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:10.330536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:10.330960 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:10.468082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:10.477000 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cbd41535-e6ee-4098-b646-d0d2b069215b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.158617 Jun 18 08:16:10.477657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 483/953] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:10 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:10.722621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:10.723503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:10.730196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:10.730625 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:10.731418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:10.731850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:10.819169 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:10.827117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b38f2d8d-959d-4d2b-9005-225f5d8b8974 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1211 microversion: 2.1 time: 0.109037 Jun 18 08:16:10.827781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 471/954] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:10 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:11.494290 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:11.494959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:11.502082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:11.502578 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:11.503472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:11.503926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:11.644124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:11.652203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b6fd63a-ee17-463c-a2b1-d4c0d492ba93 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.162069 Jun 18 08:16:11.652896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 484/955] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:11 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:11.844548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:11.845126 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:11.851850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:11.852333 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:11.853085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:11.853527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:12.021405 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:12.034707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-215dce94-a221-4875-b277-13a143f3ee99 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1278 microversion: 2.1 time: 0.194082 Jun 18 08:16:12.035346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 472/956] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:11 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:12.604816 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e6ef8c83-ae34-4306-944f-03620b293bcd req-423cabdf-ae93-4211-b720-1aac427b11a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23eed6b-7d92-400e-8d81-f35aa47e0577", "tag": "2a8dbafc-0f08-48b0-88cc-034c9a51c67a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:12.634818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e6ef8c83-ae34-4306-944f-03620b293bcd req-423cabdf-ae93-4211-b720-1aac427b11a9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:12.635283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e6ef8c83-ae34-4306-944f-03620b293bcd req-423cabdf-ae93-4211-b720-1aac427b11a9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:12.649770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e6ef8c83-ae34-4306-944f-03620b293bcd req-423cabdf-ae93-4211-b720-1aac427b11a9 service nova] Creating event network-changed:2a8dbafc-0f08-48b0-88cc-034c9a51c67a for instance c23eed6b-7d92-400e-8d81-f35aa47e0577 on hv-cinder-82634 Jun 18 08:16:12.654659 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e6ef8c83-ae34-4306-944f-03620b293bcd req-423cabdf-ae93-4211-b720-1aac427b11a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053892 Jun 18 08:16:12.655636 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 485/957] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:12.669334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:12.669946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:12.678089 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:12.678685 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:12.679498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:12.679936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:12.948563 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:12.956577 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bba6208a-2218-4529-8d52-09c9321a5590 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.291154 Jun 18 08:16:12.957163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 473/958] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:12 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:13.053077 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:13.053801 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:13.060270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:13.060715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:13.061515 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:13.061944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:13.199465 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:13.207049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-140043cc-e008-48cc-9fd1-1b7ad3c9cb9c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.158580 Jun 18 08:16:13.207600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 486/959] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:13 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:13.976534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:13.977235 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:13.984265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:13.984732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:13.985497 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:13.985928 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:14.116594 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:14.124152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a25ac94d-8567-435d-a35a-a114783580a3 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.153699 Jun 18 08:16:14.124731 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 474/960] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:13 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:14.224216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:14.224818 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:14.231440 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:14.231887 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:14.232683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:14.233106 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:14.365896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:14.373731 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4856acd4-7345-459c-bc77-e1feebf23b15 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.153574 Jun 18 08:16:14.374298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 487/961] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:14 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:15.145366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:15.146334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:15.149342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:15.150467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=12 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:15.157140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:15.157614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:15.158417 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:15.158874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:15.297123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:15.305383 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-765fbec0-5806-4d34-aa04-f09d9277ba7e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.166393 Jun 18 08:16:15.306054 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 475/962] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:15 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:15.393845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:15.394855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:15.398795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=8 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:15.407977 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:15.408726 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:15.409982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:15.410700 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:15.551029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:15.559221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-03519775-313e-4176-9ba9-265ad9bc7ea0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.171842 Jun 18 08:16:15.559779 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 488/963] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:15 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:16.322656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:16.323359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:16.330401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:16.330894 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:16.331766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:16.332259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:16.334458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-20e1b292-3859-4fd0-9716-af6c1fbe1f90 req-b166fe5f-4df9-4598-822a-a99b08bdffcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "name": "network-vif-plugged", "status": "completed", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:16.344574 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-20e1b292-3859-4fd0-9716-af6c1fbe1f90 req-b166fe5f-4df9-4598-822a-a99b08bdffcd service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:16.345010 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-20e1b292-3859-4fd0-9716-af6c1fbe1f90 req-b166fe5f-4df9-4598-822a-a99b08bdffcd service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:16.356921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-20e1b292-3859-4fd0-9716-af6c1fbe1f90 req-b166fe5f-4df9-4598-822a-a99b08bdffcd service nova] Creating event network-vif-plugged:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:16:16.362320 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-20e1b292-3859-4fd0-9716-af6c1fbe1f90 req-b166fe5f-4df9-4598-822a-a99b08bdffcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Jun 18 08:16:16.362930 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 489/964] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:16.466696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:16.474292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c08cd43e-f6a3-4bc4-8445-3499abab4642 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.155827 Jun 18 08:16:16.475068 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 476/965] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:16 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:16.576577 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:16.577312 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:16.584028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:16.584506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:16.585270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:16.585695 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:16.716790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:16.724558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d6327549-2d75-49b9-95ad-82465cd07fb7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.152779 Jun 18 08:16:16.725124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 490/966] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:16 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:17.491598 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:17.492241 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:17.499334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:17.499805 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:17.500562 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:17.500987 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:17.632226 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:17.640358 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fbdba94b-9f0d-4490-b1e5-b816d740f750 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1359 microversion: 2.1 time: 0.152714 Jun 18 08:16:17.640923 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 477/967] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:17 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:17.742157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:17.742802 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:17.749950 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:17.750394 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:17.751190 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:17.751623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:17.880352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:17.888157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-37aa0e37-1d6b-4b7d-8679-78c03aa17b01 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.150100 Jun 18 08:16:17.888723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 491/968] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:17 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:18.661689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:18.662718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:18.670651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.671184 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.671967 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.672421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.814082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:18.822168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c8956fb6-30ab-4639-a825-a44b93646b7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1548 microversion: 2.1 time: 0.167248 Jun 18 08:16:18.822746 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 478/969] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:18 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:18.838661 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:18.839299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:18.846056 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.846505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.847296 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.847721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.904419 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:18.905178 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:18.911645 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.912099 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.912874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:18.913273 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:18.986477 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:18.994285 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b0d54c19-ecca-4981-b89d-8aabe362e6de tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1548 microversion: 2.1 time: 0.159563 Jun 18 08:16:18.994817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 492/970] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:18 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:19.009973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:19.013259 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:19.014003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Searching by: {'deleted': False, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e'} {{(pid=117615) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 08:16:19.020568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:19.021016 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:19.021797 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:19.022215 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:19.048288 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:19.056667 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-baa0c134-05fc-4dab-ad49-018d8fd1a02a tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.156195 Jun 18 08:16:19.057215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 479/971] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:18 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:19.109962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.multi_cell_list [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 08:16:19.112573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:19.201196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31c0fd52-b079-4289-80ce-7edd4056092d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.194951 Jun 18 08:16:19.201783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 493/972] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Jun 18 08:16:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:19.215463 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:19.216466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:19.226534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:19.227262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:19.228024 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:19.228456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:19.373219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:19.384613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-39e0c274-8b3c-4d6a-be9e-b19fdf195fa5 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1548 microversion: 2.1 time: 0.175688 Jun 18 08:16:19.385180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 480/973] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:19 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:20.073360 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:20.074007 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:20.081090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:20.081546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:20.082352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:20.082790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:20.218954 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:20.227038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4d06b4d0-d679-432f-8502-a546de3b7098 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.157774 Jun 18 08:16:20.227621 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 494/974] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:20 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:20.919216 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4816e88-c298-4984-bfb2-14d9da256cf4"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:20.920314 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:20.927446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:20.927895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:20.928663 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:20.929120 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:21.003295 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:21.204935 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48991bf6-162c-4220-915c-e7c550ac9f99 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289634 Jun 18 08:16:21.205828 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 481/975] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Jun 18 08:16:20 2022] POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:21.243960 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:21.244613 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:21.254002 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:21.254485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:21.255317 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:21.255710 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:21.395311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:21.403147 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c2d94155-a958-4d76-8a6f-fab85009fb7e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.162989 Jun 18 08:16:21.403691 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 495/976] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:21 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:22.356462 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2eb10df4-2ea8-4e64-a2dd-24765c18cdc2 req-aa4c5ddc-faff-4c0f-8e57-a21f47d22373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23eed6b-7d92-400e-8d81-f35aa47e0577", "name": "network-vif-plugged", "status": "completed", "tag": "2a8dbafc-0f08-48b0-88cc-034c9a51c67a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:22.365961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2eb10df4-2ea8-4e64-a2dd-24765c18cdc2 req-aa4c5ddc-faff-4c0f-8e57-a21f47d22373 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:22.366389 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2eb10df4-2ea8-4e64-a2dd-24765c18cdc2 req-aa4c5ddc-faff-4c0f-8e57-a21f47d22373 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:22.377716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2eb10df4-2ea8-4e64-a2dd-24765c18cdc2 req-aa4c5ddc-faff-4c0f-8e57-a21f47d22373 service nova] Creating event network-vif-plugged:2a8dbafc-0f08-48b0-88cc-034c9a51c67a for instance c23eed6b-7d92-400e-8d81-f35aa47e0577 on hv-cinder-82634 Jun 18 08:16:22.382510 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2eb10df4-2ea8-4e64-a2dd-24765c18cdc2 req-aa4c5ddc-faff-4c0f-8e57-a21f47d22373 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Jun 18 08:16:22.383113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 482/977] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:22.422635 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:22.423303 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:22.430847 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:22.431427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:22.432446 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:22.442623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:22.584614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:22.592778 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d086b81f-7648-4d69-9ff6-f152895e9e7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.175498 Jun 18 08:16:22.593330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 496/978] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:22 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:23.615433 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:23.616836 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:23.627116 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:23.627906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:23.629166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:23.629887 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:23.770162 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:23.781983 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dff57cea-2fec-445a-a168-c6c691743655 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1266 microversion: 2.1 time: 0.174113 Jun 18 08:16:23.782786 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 483/979] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:23 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:24.803915 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:24.804809 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:24.813160 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:24.813595 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:24.814347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:24.814864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:24.959419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:24.967429 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e04bc669-dfbd-4702-bba4-9ac36466c907 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1453 microversion: 2.1 time: 0.170428 Jun 18 08:16:24.967991 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 497/980] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:24 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:24.983568 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:24.984213 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:24.991218 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:24.991666 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:24.992440 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:24.992872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:25.129143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:25.137359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-224afb9e-11ea-4241-a959-4ca3aefac33e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1453 microversion: 2.1 time: 0.157722 Jun 18 08:16:25.137931 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 484/981] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:24 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:26.776482 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-1af8dd29-69ae-4938-b3ef-ad3e8c06802f req-7e52e572-3456-4530-8535-48c42f08a614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c23eed6b-7d92-400e-8d81-f35aa47e0577", "tag": "2a8dbafc-0f08-48b0-88cc-034c9a51c67a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:26.785506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1af8dd29-69ae-4938-b3ef-ad3e8c06802f req-7e52e572-3456-4530-8535-48c42f08a614 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:26.785924 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1af8dd29-69ae-4938-b3ef-ad3e8c06802f req-7e52e572-3456-4530-8535-48c42f08a614 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:26.797345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-1af8dd29-69ae-4938-b3ef-ad3e8c06802f req-7e52e572-3456-4530-8535-48c42f08a614 service nova] Creating event network-changed:2a8dbafc-0f08-48b0-88cc-034c9a51c67a for instance c23eed6b-7d92-400e-8d81-f35aa47e0577 on hv-cinder-82634 Jun 18 08:16:26.802863 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-1af8dd29-69ae-4938-b3ef-ad3e8c06802f req-7e52e572-3456-4530-8535-48c42f08a614 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030067 Jun 18 08:16:26.803458 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 498/982] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:28.801641 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:28.802209 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:28.809065 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:28.809481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:28.810268 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:28.810695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:28.944503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:28.953164 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cc37ad70-25d9-49a8-9af1-e890076ac39d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1594 microversion: 2.1 time: 0.155628 Jun 18 08:16:28.953972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 485/983] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:28 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:30.596150 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:30.600886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-60637558-07f1-4407-a17b-2ff70017292a req-92cf2fa2-a8b0-422a-9f0c-741bad86f3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:30.604786 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:30.611887 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-60637558-07f1-4407-a17b-2ff70017292a req-92cf2fa2-a8b0-422a-9f0c-741bad86f3b2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:30.612362 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-60637558-07f1-4407-a17b-2ff70017292a req-92cf2fa2-a8b0-422a-9f0c-741bad86f3b2 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:30.627368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-60637558-07f1-4407-a17b-2ff70017292a req-92cf2fa2-a8b0-422a-9f0c-741bad86f3b2 service nova] Creating event network-changed:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:16:30.633641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-60637558-07f1-4407-a17b-2ff70017292a req-92cf2fa2-a8b0-422a-9f0c-741bad86f3b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038537 Jun 18 08:16:30.634836 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 499/984] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:31.847319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-427699089"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:31.847906 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:31.850324 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:31.855891 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:31.856334 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:31.857086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:31.857517 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:31.991908 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.network.security_group_api [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Adding security group 476afebb-bf1b-4afd-a6e2-0e044c387c3b to port 35634c13-8bea-4b9f-99d6-e32a1b1ddd59 Jun 18 08:16:32.351181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06fd2895-cceb-4f86-a3b2-01a27df3c835 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action" status: 202 len: 0 microversion: 2.1 time: 0.507874 Jun 18 08:16:32.351892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 486/985] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:16:31 2022] POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:16:32.362250 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:32.363584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:32.373078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:32.382901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:32.384203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:32.385115 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:32.536867 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:32.546157 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92cef7e2-8f51-4342-8cbf-487e94dc414c tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1759 microversion: 2.1 time: 0.189541 Jun 18 08:16:32.546753 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 500/986] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:32 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1759 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:32.648152 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-826a2d27-5c72-4952-a322-19abc74a3d4e req-9d33338a-a712-48a6-8e72-402b153e76e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:32.656734 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-826a2d27-5c72-4952-a322-19abc74a3d4e req-9d33338a-a712-48a6-8e72-402b153e76e6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:32.657201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-826a2d27-5c72-4952-a322-19abc74a3d4e req-9d33338a-a712-48a6-8e72-402b153e76e6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:32.670236 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-826a2d27-5c72-4952-a322-19abc74a3d4e req-9d33338a-a712-48a6-8e72-402b153e76e6 service nova] Creating event network-changed:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:16:32.675509 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-826a2d27-5c72-4952-a322-19abc74a3d4e req-9d33338a-a712-48a6-8e72-402b153e76e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031065 Jun 18 08:16:32.676486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 487/987] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:16:55.136265 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:16:55.137295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:55.139785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:55.140532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=38 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:55.147316 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:55.147770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:55.148540 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:55.148962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:55.235181 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dec633ea-4e8f-44db-9437-b097ca7ace57 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action" status: 202 len: 0 microversion: 2.1 time: 0.102529 Jun 18 08:16:55.235822 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 501/988] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:16:55 2022] POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:16:55.242533 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:55.243362 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:16:55.247714 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:55.248414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:55.256063 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:55.256613 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:55.257359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:55.257792 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:55.463140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:55.471569 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7d148f8c-ca0a-45e9-a255-b97a00418e7f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1751 microversion: 2.1 time: 0.230677 Jun 18 08:16:55.472231 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 488/989] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:55 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:56.492631 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:56.493769 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:56.505071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:56.505805 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:56.507271 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:56.508024 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:56.656783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:56.664920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-591fd4f3-6372-4522-bd12-e31239316736 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.178240 Jun 18 08:16:56.665492 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 502/990] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:56 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:57.683972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:57.684570 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:57.693365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:57.693812 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:57.694939 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:57.695689 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:57.864086 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:57.873670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-704d422f-7e85-4fd9-a21b-1794936b0443 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.193431 Jun 18 08:16:57.874608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:57 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:16:58.896156 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:16:58.897105 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:16:58.908247 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:58.908974 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:58.910206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:16:58.910905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:16:59.063406 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:16:59.075556 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-943ed405-a510-490e-a702-0a3ba44211c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.185583 Jun 18 08:16:59.076417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 503/992] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:16:58 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:00.097392 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:00.098028 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:00.105281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:00.105731 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:00.106496 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:00.106930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:00.258695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:00.267238 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-680a2a0c-b7ce-4292-8fd9-8d3a6f5e06a6 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.176291 Jun 18 08:17:00.267813 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 490/993] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:00 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:01.290905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:01.291545 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:01.298472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:01.298945 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:01.300131 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:01.300558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:01.505176 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:01.517794 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a4c28afc-905c-43e1-9a7c-ca0d0cf9b365 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.230691 Jun 18 08:17:01.518491 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 504/994] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:01 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:02.537899 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:02.538631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:02.546123 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:02.546588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:02.547387 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:02.547822 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:02.696772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:02.708547 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6a831758-0ed2-442b-9513-eda4c03c32c8 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.175092 Jun 18 08:17:02.709117 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 491/995] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:02 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:03.734723 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:03.735697 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:03.744246 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:03.744664 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:03.745438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:03.745841 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:03.898694 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:03.911209 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a353379-3709-4a90-8ad2-7320ef55c651 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.182558 Jun 18 08:17:03.911856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 505/996] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:03 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:04.934553 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:04.935551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:04.945087 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:04.945536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:04.946304 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:04.946731 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:05.146477 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:05.154901 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a3985838-3047-4d57-983b-e2a9e8cd0fb2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.226894 Jun 18 08:17:05.155476 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 492/997] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:04 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:06.172358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:06.172983 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:06.180305 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:06.180743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:06.181495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:06.181915 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:06.326447 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:06.334795 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66947f6c-99fa-458b-9c6b-816f57cc6999 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.166403 Jun 18 08:17:06.335404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 506/998] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:06 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:07.356143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:07.357083 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:07.366934 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:07.367415 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:07.368181 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:07.368635 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:07.511748 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:07.520080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3e1d084d-9b3d-4f16-8c28-6cad6cdd21ed tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.170521 Jun 18 08:17:07.520705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 493/999] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:07 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:08.539586 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:08.540193 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:08.547271 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:08.547716 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:08.548480 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:08.548905 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:08.690855 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:08.699543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cec19200-37ae-4013-bca0-187da7477c7b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.164604 Jun 18 08:17:08.700089 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 507/1000] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:08 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:09.720658 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:09.721620 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:09.732574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:09.733269 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:09.734509 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:09.735257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:09.898421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:09.908862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8b465f84-ca27-481c-a335-964771186360 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.194603 Jun 18 08:17:09.909672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 494/1001] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:09 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:10.931090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:10.932122 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:10.943036 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:10.943522 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:10.944278 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:10.944709 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:11.097667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:11.105976 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bfa6a616-a242-455b-85d3-406199c9f29e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1756 microversion: 2.1 time: 0.181891 Jun 18 08:17:11.106523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 508/1002] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:10 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:12.127727 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:12.128681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:12.136946 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:12.137501 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:12.138346 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:12.138823 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:12.282897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:12.291476 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-70c2256c-7259-4874-a727-f3c8f763801a tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1759 microversion: 2.1 time: 0.170538 Jun 18 08:17:12.292055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 495/1003] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:12 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:45.408899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-427699089"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:17:45.409912 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:45.413418 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=16 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:17:45.414469 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:17:45.424483 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:45.424911 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:45.425683 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:45.426137 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:45.555869 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.network.security_group_api [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Removing security group 476afebb-bf1b-4afd-a6e2-0e044c387c3b from port 35634c13-8bea-4b9f-99d6-e32a1b1ddd59 Jun 18 08:17:46.151593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b1442261-a6f2-4094-9c97-9122820e210b tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action" status: 202 len: 0 microversion: 2.1 time: 0.749519 Jun 18 08:17:46.152427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 509/1004] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:17:45 2022] POST /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:17:46.164276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5cf59660-7e09-4904-9768-2c8663e926c8 req-cff7e4bd-e26c-4307-a7fd-299a31e4a391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:17:46.173569 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=16 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:17:46.177219 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=48 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:17:46.195343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5cf59660-7e09-4904-9768-2c8663e926c8 req-cff7e4bd-e26c-4307-a7fd-299a31e4a391 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:46.196026 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5cf59660-7e09-4904-9768-2c8663e926c8 req-cff7e4bd-e26c-4307-a7fd-299a31e4a391 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:46.218412 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5cf59660-7e09-4904-9768-2c8663e926c8 req-cff7e4bd-e26c-4307-a7fd-299a31e4a391 service nova] Creating event network-changed:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:17:46.225173 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5cf59660-7e09-4904-9768-2c8663e926c8 req-cff7e4bd-e26c-4307-a7fd-299a31e4a391 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066797 Jun 18 08:17:46.226575 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 496/1005] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:17:47.334282 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:47.334854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:47.341270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:47.341718 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:47.342492 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:47.342915 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:47.423937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lazy-loading 'services' on Instance uuid 17a15584-23a4-4b95-86c5-85678898e102 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:17:47.500334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f9a7bf19-4c95-4c22-951a-fc4ae3cbc612 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments/b4816e88-c298-4984-bfb2-14d9da256cf4" status: 202 len: 0 microversion: 2.1 time: 0.170415 Jun 18 08:17:47.500986 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 510/1006] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:17:47 2022] DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments/b4816e88-c298-4984-bfb2-14d9da256cf4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:17:47.511842 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:47.512672 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:47.519683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:47.520191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:47.521037 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:47.521643 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:47.563000 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f11524c-460c-4719-98dd-3d076d62c441 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056757 Jun 18 08:17:47.564025 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 497/1007] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:17:47 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:17:48.241846 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-1b78c18b-bd82-4618-8c58-bd4ec41e23c4 req-3e8e7327-4bdc-4c70-97e7-51946528c4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:17:48.250200 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1b78c18b-bd82-4618-8c58-bd4ec41e23c4 req-3e8e7327-4bdc-4c70-97e7-51946528c4ed service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:48.250738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1b78c18b-bd82-4618-8c58-bd4ec41e23c4 req-3e8e7327-4bdc-4c70-97e7-51946528c4ed service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:48.269481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-1b78c18b-bd82-4618-8c58-bd4ec41e23c4 req-3e8e7327-4bdc-4c70-97e7-51946528c4ed service nova] Creating event network-changed:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:17:48.275245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-1b78c18b-bd82-4618-8c58-bd4ec41e23c4 req-3e8e7327-4bdc-4c70-97e7-51946528c4ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037490 Jun 18 08:17:48.275925 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 511/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:17:48.576428 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:48.577370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:48.584449 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:48.584764 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:48.585498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:48.585936 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:48.615199 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-26d7d930-d03b-4e26-8e86-3534e4cd03ff tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042606 Jun 18 08:17:48.615752 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 498/1009] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Jun 18 08:17:48 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 08:17:48.629068 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:48.629782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:48.636352 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:48.636802 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:48.637577 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:48.638011 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:48.713884 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] HTTP exception thrown: Instance 17a15584-23a4-4b95-86c5-85678898e102 is not attached to volume b4816e88-c298-4984-bfb2-14d9da256cf4 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Request method failure captured: Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments/b4816e88-c298-4984-bfb2-14d9da256cf4 HTTP/1.1 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYmsqvaMiXtooZrdoRtE3ri9-6jT-YEcAHTmD4Aj_Tzpt_UXb5e5zjoRQrOsHSmPuFSl9kbR0gyV8jbcvvOwoYKhKCNvgjtnIYfUEy9sOH4D7yI7bcYEGYe4S2dpzY2uJ1Vmrblh6djdZbyPau51_JrNj1lHWxsVsFUNEaa5U-IAbjc Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: ea8b2e1c7f6d4e10b9bc871803dfcf0e Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:17:48.716339 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea8b2e1c7f6d4e10b9bc871803dfcf0e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: ea8b2e1c7f6d4e10b9bc871803dfcf0e Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-TestMinimumBasicScenario-1871714075-project Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 2f44bfdb4cef4d87845b53bccee17a83 Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestMinimumBasicScenario-1871714075-project Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:17:48.717978 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 17a15584-23a4-4b95-86c5-85678898e102 is not attached to volume b4816e88-c298-4984-bfb2-14d9da256cf4 Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'server_id': '17a15584-23a4-4b95-86c5-85678898e102', 'id': 'b4816e88-c298-4984-bfb2-14d9da256cf4'} Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b4816e88-c298-4984-bfb2-14d9da256cf4. Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:17:48.719113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a15584-23a4-4b95-86c5-85678898e102 is not attached to volume b4816e88-c298-4984-bfb2-14d9da256cf4 Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a15584-23a4-4b95-86c5-85678898e102 is not attached to volume b4816e88-c298-4984-bfb2-14d9da256cf4 Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:48.720523 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Returning 404 to user: Instance 17a15584-23a4-4b95-86c5-85678898e102 is not attached to volume b4816e88-c298-4984-bfb2-14d9da256cf4 {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:17:48.721897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5b254091-f83e-4340-b6f6-b481ff9e1b8f tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments/b4816e88-c298-4984-bfb2-14d9da256cf4" status: 404 len: 154 microversion: 2.1 time: 0.093884 Jun 18 08:17:48.721897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 512/1010] 10.222.0.23 () {58 vars in 1415 bytes} [Sat Jun 18 08:17:48 2022] DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102/os-volume_attachments/b4816e88-c298-4984-bfb2-14d9da256cf4 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:17:49.872630 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:49.873150 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:49.882855 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:49.883520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:49.884696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:49.885326 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:49.916597 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:17:49.999280 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-66e4cb2d-9fc1-4d04-813f-687e7f84f5ce tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 204 len: 0 microversion: 2.1 time: 0.132297 Jun 18 08:17:50.000098 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 499/1011] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:17:49 2022] DELETE /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:17:50.008222 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:50.008837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:50.015404 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:50.015845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:50.016599 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:50.017148 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:50.154662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:50.162811 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1d6f0cde-9c86-4e04-97ed-13b5e83750b2 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1554 microversion: 2.1 time: 0.158592 Jun 18 08:17:50.163427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 513/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:50 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:17:51.185645 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:51.186778 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:51.197669 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:51.198401 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:51.199695 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:51.200395 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:51.338148 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:51.349551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f44c9554-2236-4538-af0c-5f1ac6f23f4e tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1554 microversion: 2.1 time: 0.170908 Jun 18 08:17:51.350223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 500/1013] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:51 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:52.272413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-69031e97-fa6d-4c80-8bab-26743ed63f3f req-1b36fe81-c40b-41aa-be8a-58d2283b55c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a15584-23a4-4b95-86c5-85678898e102", "name": "network-vif-deleted", "tag": "35634c13-8bea-4b9f-99d6-e32a1b1ddd59"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:17:52.282943 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-69031e97-fa6d-4c80-8bab-26743ed63f3f req-1b36fe81-c40b-41aa-be8a-58d2283b55c0 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:52.283390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-69031e97-fa6d-4c80-8bab-26743ed63f3f req-1b36fe81-c40b-41aa-be8a-58d2283b55c0 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:52.295221 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-69031e97-fa6d-4c80-8bab-26743ed63f3f req-1b36fe81-c40b-41aa-be8a-58d2283b55c0 service nova] Creating event network-vif-deleted:35634c13-8bea-4b9f-99d6-e32a1b1ddd59 for instance 17a15584-23a4-4b95-86c5-85678898e102 on hv-cinder-82634 Jun 18 08:17:52.301291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-69031e97-fa6d-4c80-8bab-26743ed63f3f req-1b36fe81-c40b-41aa-be8a-58d2283b55c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 Jun 18 08:17:52.302219 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 514/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:17:52.369980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:52.370777 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:52.377892 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:52.378388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:52.379701 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:52.380487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:52.417196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:52.417870 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:52.418060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lazy-loading 'fault' on Instance uuid 17a15584-23a4-4b95-86c5-85678898e102 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:17:52.460408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f44bfdb4cef4d87845b53bccee17a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8b2e1c7f6d4e10b9bc871803dfcf0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:17:52.470897 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06b866f7-113a-4cd7-af86-fb6dcd1de804 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 200 len: 1349 microversion: 2.1 time: 0.104703 Jun 18 08:17:52.471503 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 501/1015] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:52 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:17:53.489530 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:53.490241 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] [instance: 17a15584-23a4-4b95-86c5-85678898e102] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:17:53.497485 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:53.497921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:53.498673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:17:53.499129 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:17:53.513359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] HTTP exception thrown: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Request method failure captured: Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 HTTP/1.1 Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYmsqvaMiXtooZrdoRtE3ri9-6jT-YEcAHTmD4Aj_Tzpt_UXb5e5zjoRQrOsHSmPuFSl9kbR0gyV8jbcvvOwoYKhKCNvgjtnIYfUEy9sOH4D7yI7bcYEGYe4S2dpzY2uJ1Vmrblh6djdZbyPau51_JrNj1lHWxsVsFUNEaa5U-IAbjc Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: ea8b2e1c7f6d4e10b9bc871803dfcf0e Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:17:53.514952 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea8b2e1c7f6d4e10b9bc871803dfcf0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea8b2e1c7f6d4e10b9bc871803dfcf0e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: ea8b2e1c7f6d4e10b9bc871803dfcf0e Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1871714075 Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-TestMinimumBasicScenario-1871714075-project Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 2f44bfdb4cef4d87845b53bccee17a83 Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestMinimumBasicScenario-1871714075-project Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. Jun 18 08:17:53.516597 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': '17a15584-23a4-4b95-86c5-85678898e102'} Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:17:53.517611 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. Jun 18 08:17:53.519138 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:17:53.520528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Returning 404 to user: Instance 17a15584-23a4-4b95-86c5-85678898e102 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:17:53.520528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d25da2de-70d3-497c-90a1-cc49a4c28912 tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102" status: 404 len: 111 microversion: 2.1 time: 0.031325 Jun 18 08:17:53.520528 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 515/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:17:53 2022] GET /compute/v2.1/servers/17a15584-23a4-4b95-86c5-85678898e102 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:17:53.525102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a58409f-2e7d-49b9-9072-0a30a0a3f56d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] Calling method '.version_select at 0x7f3be4329d30>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:17:53.544435 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a58409f-2e7d-49b9-9072-0a30a0a3f56d tempest-TestMinimumBasicScenario-1871714075 tempest-TestMinimumBasicScenario-1871714075-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2050283830" status: 202 len: 0 microversion: 2.1 time: 0.023045 Jun 18 08:17:53.545196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 502/1017] 10.222.0.23 () {58 vars in 1271 bytes} [Sat Jun 18 08:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2050283830 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:18:10.804532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=14 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:10.805269 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:10.997677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Action: 'create', calling method: .version_select at 0x7f3bdf5974c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-847615162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLOYD8PjUk6canlXHHcFTIEpSYzZiENQV1+Z44TQXSQZudNehvk4oCAz106lkzrd+i67sMrGmlS2Tatk2P5JHXcJCcr/HmIFa+v0/Co+I33uGVZHxf3vTnK/KVdwAYCiQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:11.012100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Getting quotas for project b6902aa20d9248c7aa91d2559e5cabb6. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:18:11.017362 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Getting quotas for user 7d68eee466d948acbe1b74bb45dc3c19 and project b6902aa20d9248c7aa91d2559e5cabb6. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:18:11.032385 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [5399e508-782d-4fb4-b45e-571f688c9b9e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 08:18:12.047216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [5399e508-782d-4fb4-b45e-571f688c9b9e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33662. Jun 18 08:18:12.070900 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5da7b577-192b-4661-a7d3-b7690626e208 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.272887 Jun 18 08:18:12.071543 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 516/1018] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Jun 18 08:18:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:18:23.979307 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:23.980073 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:23.984705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:23.985052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:23.994182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:23.994723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:23.995662 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:23.996312 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:24.024224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:18:24.107775 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f673ece1-432a-4e6f-a330-45b483c5908d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 204 len: 0 microversion: 2.1 time: 0.129747 Jun 18 08:18:24.108310 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 503/1019] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:18:23 2022] DELETE /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:18:24.114740 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:24.115473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:24.119604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:24.120203 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:24.127295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:24.127728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:24.128490 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:24.128917 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:24.268964 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:24.280777 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b035356d-0dbe-4366-bb45-6b56b06ac9ef tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1578 microversion: 2.1 time: 0.167516 Jun 18 08:18:24.281364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 517/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:24 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:25.299331 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:25.300357 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:25.307250 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:25.307724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:25.308491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:25.308922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:25.445306 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:25.453446 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0a97dddc-fdbd-4c30-bd8b-bf6c58ba1a72 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1578 microversion: 2.1 time: 0.158493 Jun 18 08:18:25.453978 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 504/1021] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:25 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:26.469827 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:26.470442 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:26.477052 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:26.477512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:26.478628 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:26.479120 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:26.556038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:26.565584 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-454c3c61-77a9-4c10-b725-638a99ca66bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 200 len: 1511 microversion: 2.1 time: 0.099631 Jun 18 08:18:26.566294 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 518/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:26 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:26.883544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b991fde3-e93c-4692-af18-d06ca8859211 req-36fb5425-9ba2-4b93-9594-24dde0b3e63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c23eed6b-7d92-400e-8d81-f35aa47e0577", "name": "network-vif-deleted", "tag": "2a8dbafc-0f08-48b0-88cc-034c9a51c67a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:26.897188 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b991fde3-e93c-4692-af18-d06ca8859211 req-36fb5425-9ba2-4b93-9594-24dde0b3e63f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:26.897645 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b991fde3-e93c-4692-af18-d06ca8859211 req-36fb5425-9ba2-4b93-9594-24dde0b3e63f service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:26.909632 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b991fde3-e93c-4692-af18-d06ca8859211 req-36fb5425-9ba2-4b93-9594-24dde0b3e63f service nova] Creating event network-vif-deleted:2a8dbafc-0f08-48b0-88cc-034c9a51c67a for instance c23eed6b-7d92-400e-8d81-f35aa47e0577 on hv-cinder-82634 Jun 18 08:18:26.917867 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b991fde3-e93c-4692-af18-d06ca8859211 req-36fb5425-9ba2-4b93-9594-24dde0b3e63f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133356 Jun 18 08:18:26.922257 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 505/1023] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:27.382790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-144156896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-847615162", "security_groups": [{"name": "tempest-secgroup-smoke-1083170249"}], "networks": [{"uuid": "dd967248-94f7-4b62-9f2e-eb58b4e23e48"}], "block_device_mapping_v2": [{"uuid": "8a35bd51-0f62-441c-bd08-e4f046212ddd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:27.507044 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] validate_networks() for [('dd967248-94f7-4b62-9f2e-eb58b4e23e48', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:18:27.587149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:27.587993 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:27.595947 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:27.596569 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:27.597527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:27.597952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:27.612621 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] HTTP exception thrown: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Request method failure captured: Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 HTTP/1.1 Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYmsl764ch1c3OSgs0tmqoWXHnNzQB-Cz6HPzzhizW7K1R3PP_nDYIYe1-HmDyULxi_ovpE7OBTFZ2hBFnRe1xdcGAlno5dbyQnMmPjABE5MKu0z7X5Blyu24oQermtelge4xV0hvrsus0Ks7s-9FFj9pHwMKxGvkIEp06f38_ET4qQ Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:18:27.614313 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49e317feb48548bba0745b2297130f5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49e317feb48548bba0745b2297130f5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 1e35908c10cc4627a655a283cc60c128 Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:18:27.616143 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'c23eed6b-7d92-400e-8d81-f35aa47e0577'} Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:18:27.617266 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:18:27.618882 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:18:27.620349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Returning 404 to user: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:18:27.620349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-238e1fad-ae3f-48a6-bb69-7458e370e911 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 404 len: 111 microversion: 2.1 time: 0.036220 Jun 18 08:18:27.620349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 506/1024] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:27 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:18:27.717917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1871920450", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1725692452", "security_groups": [{"name": "tempest-secgroup-smoke-405259699"}], "block_device_mapping_v2": [{"uuid": "303f9ae6-3182-41fc-a0cc-306818c4f06a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05510254-5856-414b-a3c7-167e95f14eac"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:27.852847 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] validate_networks() for [('05510254-5856-414b-a3c7-167e95f14eac', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:18:28.030524 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:18:28.030981 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:18:28.031488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:18:28.031891 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:18:28.032295 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:18:28.041266 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:28.041680 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:28.042467 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:28.042896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:28.060235 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Getting quotas for project b6902aa20d9248c7aa91d2559e5cabb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:18:28.064272 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Getting quotas for user 7d68eee466d948acbe1b74bb45dc3c19 and project b6902aa20d9248c7aa91d2559e5cabb6. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:18:28.120082 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:18:28.122197 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a35bd51-0f62-441c-bd08-e4f046212ddd',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:18:28.248057 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:18:28.248724 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:18:28.249365 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:18:28.249839 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:18:28.250316 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:18:28.261898 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:28.262464 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:28.263368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:28.263874 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:28.269861 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [40c1a552-ed13-41ee-b607-22153a2677e7] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 08:18:28.280843 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:18:28.284965 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for user 1e35908c10cc4627a655a283cc60c128 and project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:18:28.342830 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:18:28.345007 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='303f9ae6-3182-41fc-a0cc-306818c4f06a',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:18:28.471407 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [00df4d89-56fe-4b37-be40-dcba83eb9447] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 08:18:29.282397 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [40c1a552-ed13-41ee-b607-22153a2677e7] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33810. Jun 18 08:18:29.289376 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2c00b752-532c-4c02-8e76-35b957cc85eb tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.910265 Jun 18 08:18:29.295186 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 519/1025] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:18:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:18:29.302622 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a271161c-cbfc-46c9-9cc1-be43b5921327 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:29.303299 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a271161c-cbfc-46c9-9cc1-be43b5921327 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:29.360009 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a271161c-cbfc-46c9-9cc1-be43b5921327 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:29.369216 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a271161c-cbfc-46c9-9cc1-be43b5921327 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1087 microversion: 2.1 time: 0.070647 Jun 18 08:18:29.369782 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 520/1026] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:29 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:29.482589 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [00df4d89-56fe-4b37-be40-dcba83eb9447] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33814. Jun 18 08:18:29.487733 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d1701f43-b948-462f-81aa-301feb163350 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.773774 Jun 18 08:18:29.488512 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 507/1027] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:18:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:18:29.498715 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e0b9486d-87d5-4ee0-8a39-eed1c00079dc tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:29.499374 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e0b9486d-87d5-4ee0-8a39-eed1c00079dc tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:29.554496 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e0b9486d-87d5-4ee0-8a39-eed1c00079dc tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:29.562180 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e0b9486d-87d5-4ee0-8a39-eed1c00079dc tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1095 microversion: 2.1 time: 0.067331 Jun 18 08:18:29.562751 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 521/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:29 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:30.386311 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b74ee331-8197-4f11-a30f-b724f9dcd637 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:30.386922 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b74ee331-8197-4f11-a30f-b724f9dcd637 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:30.441246 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b74ee331-8197-4f11-a30f-b724f9dcd637 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:30.448744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b74ee331-8197-4f11-a30f-b724f9dcd637 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1087 microversion: 2.1 time: 0.066885 Jun 18 08:18:30.449327 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 508/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:30 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:30.580800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ddeb8129-7e12-4fa1-915c-69e07f9f2831 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:30.581390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ddeb8129-7e12-4fa1-915c-69e07f9f2831 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:30.639764 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ddeb8129-7e12-4fa1-915c-69e07f9f2831 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:30.646935 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ddeb8129-7e12-4fa1-915c-69e07f9f2831 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1095 microversion: 2.1 time: 0.072016 Jun 18 08:18:30.647468 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 522/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:30 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:31.465651 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:31.466329 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:31.473716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:31.474135 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:31.474918 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:31.475384 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:31.552242 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:31.560246 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a99a7de6-fa80-412e-8208-7dc1f10eefa8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1203 microversion: 2.1 time: 0.098468 Jun 18 08:18:31.560827 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 509/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:31 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1203 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:31.665105 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a251fa9-8033-4bf3-b34e-7189bff24143 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:31.665679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a251fa9-8033-4bf3-b34e-7189bff24143 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:31.719975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2a251fa9-8033-4bf3-b34e-7189bff24143 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:31.726898 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a251fa9-8033-4bf3-b34e-7189bff24143 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1095 microversion: 2.1 time: 0.065748 Jun 18 08:18:31.727495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 523/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:31 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:32.577966 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:32.578831 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:32.588700 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:32.589392 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:32.591704 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:32.592716 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:32.743810 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:32.744623 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:32.762668 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:32.763171 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:32.764074 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:32.764565 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:32.839745 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:32.848874 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-50bb4d30-7d83-4518-9bfa-d2c66269cb53 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1201 microversion: 2.1 time: 0.108857 Jun 18 08:18:32.849473 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 524/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:32 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:18:32.882284 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-5c722569-1152-4a89-a6a3-41bc7259b654 req-1196aa20-2b62-46c6-bdc8-d0cb1e3d96d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:32.903790 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:32.920854 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9ff17269-17fe-494a-8f7b-19a963f625e6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.344931 Jun 18 08:18:32.933880 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 510/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:32 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:32.937005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5c722569-1152-4a89-a6a3-41bc7259b654 req-1196aa20-2b62-46c6-bdc8-d0cb1e3d96d9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:32.937481 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5c722569-1152-4a89-a6a3-41bc7259b654 req-1196aa20-2b62-46c6-bdc8-d0cb1e3d96d9 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:32.950880 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-5c722569-1152-4a89-a6a3-41bc7259b654 req-1196aa20-2b62-46c6-bdc8-d0cb1e3d96d9 service nova] Creating event network-changed:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:18:32.956347 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-5c722569-1152-4a89-a6a3-41bc7259b654 req-1196aa20-2b62-46c6-bdc8-d0cb1e3d96d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087887 Jun 18 08:18:32.956969 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 525/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:33.866582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:33.867527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:33.875055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:33.875683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:33.876548 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:33.877360 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:33.938946 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:33.939897 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:33.946393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:33.946842 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:33.947646 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:33.948078 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:34.094360 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:34.102466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb076eb6-3a1f-4306-bee8-aa26db77d4c4 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.168357 Jun 18 08:18:34.103202 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 526/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:33 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:18:34.197835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:34.205772 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ed798c96-c5ff-4bc9-9a2d-1074a9c45400 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.343555 Jun 18 08:18:34.206527 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 511/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:33 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:35.119571 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:35.120844 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:35.127860 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:35.128389 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:35.129251 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:35.129741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:35.213134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2f700166-c412-4eb8-aad6-e7141fef4226 req-2986b3a4-2e09-4b2a-9840-fa5cb9f17cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5573a143-a4e9-442f-99ed-0abd0d5cadcc", "tag": "e4b5e076-5761-45c9-96b4-5ee38ce31514"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:35.236606 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f700166-c412-4eb8-aad6-e7141fef4226 req-2986b3a4-2e09-4b2a-9840-fa5cb9f17cbc service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:35.237093 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f700166-c412-4eb8-aad6-e7141fef4226 req-2986b3a4-2e09-4b2a-9840-fa5cb9f17cbc service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:35.259571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2f700166-c412-4eb8-aad6-e7141fef4226 req-2986b3a4-2e09-4b2a-9840-fa5cb9f17cbc service nova] Creating event network-changed:e4b5e076-5761-45c9-96b4-5ee38ce31514 for instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc on hv-cinder-82634 Jun 18 08:18:35.265319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2f700166-c412-4eb8-aad6-e7141fef4226 req-2986b3a4-2e09-4b2a-9840-fa5cb9f17cbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055983 Jun 18 08:18:35.266298 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 512/1038] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:35.271470 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:35.272423 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:35.279507 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:35.279705 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:35.280018 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:35.280801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:35.281293 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:35.290937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3227a31f-0500-4254-aa0b-f1d317bf7aac tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.174624 Jun 18 08:18:35.292252 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 527/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:35 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:35.497106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:35.505111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-05d5bf6e-7c8d-4a16-ae29-098dd377018e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.237652 Jun 18 08:18:35.505683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 513/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:35 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:36.308748 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:36.309314 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:36.316154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:36.316593 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:36.317345 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:36.317749 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:36.455112 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:36.463918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73e415c4-d9a9-4937-ba77-7af060917869 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.159169 Jun 18 08:18:36.464499 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 528/1041] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:36 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:36.521989 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:36.522542 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:36.529515 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:36.529961 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:36.530720 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:36.531264 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:36.669425 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:36.677680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b2083732-30d4-4c85-a7a6-31ffb5c0ecfa tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.159708 Jun 18 08:18:36.678243 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 514/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:36 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:37.485123 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:37.485730 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:37.492824 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:37.493259 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:37.494048 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:37.494466 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:37.625415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:37.637243 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ed93a56-947f-4cb9-aaab-456132e90e31 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.158816 Jun 18 08:18:37.638039 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 529/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:37 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:37.694652 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:37.695243 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:37.702134 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:37.702608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:37.703418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:37.703848 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:37.843236 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:37.851413 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d23962e9-978e-4f38-b683-e47d36703fbe tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.160646 Jun 18 08:18:37.851983 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 515/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:37 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:38.658726 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:38.659728 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:38.662868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:38.672817 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:38.673547 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:38.674849 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:38.675987 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:38.834137 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:38.844939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66b31076-bb5b-4828-a910-1ffc24ed0fa5 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.192862 Jun 18 08:18:38.845519 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 530/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:38 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:38.868247 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:38.868832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:38.870801 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:38.877335 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:38.877778 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:38.878536 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:38.878960 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:39.013215 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:39.020857 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dd649e05-4394-4abc-890b-a4ecdc9e44a0 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.156487 Jun 18 08:18:39.021466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 516/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:38 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:39.862395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:39.862971 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:39.869936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:39.870364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:39.871154 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:39.871576 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:40.012729 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:40.021726 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09f1bc84-62d9-45c6-93ba-4eec466f9929 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.163427 Jun 18 08:18:40.022362 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 531/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:39 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:40.038010 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:40.038588 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:40.045404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:40.045848 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:40.046609 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:40.047073 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:40.202631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:40.212846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4a87df0d-a875-4be3-ac4d-5cb0973c260c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.178526 Jun 18 08:18:40.213544 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 517/1048] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:40 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:41.037783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:41.038395 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:41.045591 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:41.046118 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:41.046893 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:41.047354 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:41.183600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:41.191907 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-90246112-05b1-4990-b55d-33478229bd5e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.157992 Jun 18 08:18:41.192526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 532/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:41 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:41.232437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:41.233141 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:41.235142 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:41.241456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:41.241837 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:41.242603 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:41.243043 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:41.377980 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:41.389050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9d865db3-1d8c-4acd-a882-4bfeaaad737b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.160576 Jun 18 08:18:41.389617 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 518/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:41 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:42.217413 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:42.218283 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:42.221242 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=14 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:42.230899 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:42.231673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:42.232918 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:42.234229 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:42.374383 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:42.383184 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8af1863c-15c5-4895-984a-29aaa2db5967 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.172321 Jun 18 08:18:42.383720 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 533/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:42 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:42.408106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:42.408691 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:42.415693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:42.416140 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:42.416903 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:42.417339 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:42.563092 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:42.571408 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82a45491-6ea5-4069-84e9-e0997790bf1b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.168489 Jun 18 08:18:42.571950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 519/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:42 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:43.230136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-36a70e64-ecde-40f7-b64e-f77363af818d req-6e30c2c2-2858-4442-9199-063177f28373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "name": "network-vif-plugged", "status": "completed", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:43.238354 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-36a70e64-ecde-40f7-b64e-f77363af818d req-6e30c2c2-2858-4442-9199-063177f28373 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:43.238763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-36a70e64-ecde-40f7-b64e-f77363af818d req-6e30c2c2-2858-4442-9199-063177f28373 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:43.250228 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-36a70e64-ecde-40f7-b64e-f77363af818d req-6e30c2c2-2858-4442-9199-063177f28373 service nova] Creating event network-vif-plugged:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:18:43.255364 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-36a70e64-ecde-40f7-b64e-f77363af818d req-6e30c2c2-2858-4442-9199-063177f28373 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088073 Jun 18 08:18:43.255953 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 534/1053] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:43.401155 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:43.401895 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:43.408815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:43.409455 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:43.410008 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:43.410436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:43.590227 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:43.591368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:43.600072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:43.600763 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:43.601735 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:43.602330 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:43.614549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:43.622283 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f919f69b-7bff-465c-a6ee-1313a24eace6 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1259 microversion: 2.1 time: 0.226081 Jun 18 08:18:43.622935 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 520/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:43 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:43.733558 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:43.741256 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e9e8227a-f6e1-49ec-b52d-94d37e238ae7 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.157115 Jun 18 08:18:43.741829 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 535/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:43 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:44.640027 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:44.640656 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:44.647370 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.647815 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.648571 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.649002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.666941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:18:44.757783 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:44.758342 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:44.765206 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.765679 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.766439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.766854 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.795605 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:44.804492 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2bab91f4-2601-4c57-a397-73d5b263531f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1443 microversion: 2.1 time: 0.168329 Jun 18 08:18:44.804950 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 521/1056] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:44 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:44.820368 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:44.820972 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:44.827164 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.827597 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.828512 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:44.828941 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:44.903944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:44.912616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e6679f1-aab9-41ba-a487-b68088f8be0c tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.158726 Jun 18 08:18:44.915175 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 536/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:44 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:44.968702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:44.978881 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6e70591d-4d22-42e3-9cd9-1625d65a21d9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1443 microversion: 2.1 time: 0.162261 Jun 18 08:18:44.979649 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 522/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:44 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 08:18:45.272236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-26bdb53a-f605-4659-be9a-d945ad7f015b req-3418fee1-fc09-46ca-ba8e-9f04affe3537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5573a143-a4e9-442f-99ed-0abd0d5cadcc", "name": "network-vif-plugged", "status": "completed", "tag": "e4b5e076-5761-45c9-96b4-5ee38ce31514"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:45.280183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-26bdb53a-f605-4659-be9a-d945ad7f015b req-3418fee1-fc09-46ca-ba8e-9f04affe3537 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:45.280612 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-26bdb53a-f605-4659-be9a-d945ad7f015b req-3418fee1-fc09-46ca-ba8e-9f04affe3537 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:45.291529 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-26bdb53a-f605-4659-be9a-d945ad7f015b req-3418fee1-fc09-46ca-ba8e-9f04affe3537 service nova] Creating event network-vif-plugged:e4b5e076-5761-45c9-96b4-5ee38ce31514 for instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc on hv-cinder-82634 Jun 18 08:18:45.296358 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-26bdb53a-f605-4659-be9a-d945ad7f015b req-3418fee1-fc09-46ca-ba8e-9f04affe3537 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027812 Jun 18 08:18:45.297153 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 537/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:45.930469 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:45.931071 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:45.938017 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:45.938451 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:45.939259 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:45.939690 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:46.153816 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:46.161670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5d1ad62e-d2f3-42ef-a700-5162e41e5990 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1266 microversion: 2.1 time: 0.235651 Jun 18 08:18:46.162262 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 523/1060] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:45 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:46.747121 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-02590576-7f72-41b0-8d49-0fc6c6460555 req-d88447be-37fe-4d63-9ebd-aeb136624943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:46.755484 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-02590576-7f72-41b0-8d49-0fc6c6460555 req-d88447be-37fe-4d63-9ebd-aeb136624943 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:46.755919 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-02590576-7f72-41b0-8d49-0fc6c6460555 req-d88447be-37fe-4d63-9ebd-aeb136624943 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:46.766657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-02590576-7f72-41b0-8d49-0fc6c6460555 req-d88447be-37fe-4d63-9ebd-aeb136624943 service nova] Creating event network-changed:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:18:46.771614 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-02590576-7f72-41b0-8d49-0fc6c6460555 req-d88447be-37fe-4d63-9ebd-aeb136624943 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028991 Jun 18 08:18:46.772427 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 538/1061] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:18:47.178457 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:47.179233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:47.185983 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:47.186713 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:47.187705 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:47.188136 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:47.389876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:47.398263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25d3170a-b190-4f4e-8dd3-51403df3f5ed tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1453 microversion: 2.1 time: 0.224159 Jun 18 08:18:47.409168 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 524/1062] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:47 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1453 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:47.416478 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:18:47.417174 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:18:47.423928 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:47.424378 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:47.425152 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:47.425939 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:47.577261 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:18:47.585365 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8096158-aeda-4f86-a959-ced77fc61383 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1453 microversion: 2.1 time: 0.173183 Jun 18 08:18:47.586280 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 539/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:18:47 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:18:49.475670 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b8de0715-6b04-4375-8a8d-fe4fc0c6f4a3 req-098ae8e0-d84a-4650-99ed-9ce8126f1588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5573a143-a4e9-442f-99ed-0abd0d5cadcc", "tag": "e4b5e076-5761-45c9-96b4-5ee38ce31514"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:18:49.484551 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b8de0715-6b04-4375-8a8d-fe4fc0c6f4a3 req-098ae8e0-d84a-4650-99ed-9ce8126f1588 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:18:49.485032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b8de0715-6b04-4375-8a8d-fe4fc0c6f4a3 req-098ae8e0-d84a-4650-99ed-9ce8126f1588 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:18:49.498599 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b8de0715-6b04-4375-8a8d-fe4fc0c6f4a3 req-098ae8e0-d84a-4650-99ed-9ce8126f1588 service nova] Creating event network-changed:e4b5e076-5761-45c9-96b4-5ee38ce31514 for instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc on hv-cinder-82634 Jun 18 08:18:49.503952 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b8de0715-6b04-4375-8a8d-fe4fc0c6f4a3 req-098ae8e0-d84a-4650-99ed-9ce8126f1588 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Jun 18 08:18:49.504825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 525/1064] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:20:22.396049 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:20:22.397154 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Sat Jun 18 08:20:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:20:24.854439 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:24.855218 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=94 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:24.859495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2028920065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1725692452", "security_groups": [{"name": "tempest-secgroup-smoke-405259699"}], "block_device_mapping_v2": [{"uuid": "f3022867-49cb-466b-bdd3-ff18e5199e53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05510254-5856-414b-a3c7-167e95f14eac"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:24.980800 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] validate_networks() for [('05510254-5856-414b-a3c7-167e95f14eac', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 08:20:25.575559 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 08:20:25.576124 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 08:20:25.576920 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 08:20:25.577513 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 08:20:25.578159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 08:20:25.593287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:25.594006 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:25.595192 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:25.595773 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:25.617534 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 08:20:25.621704 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Getting quotas for user 1e35908c10cc4627a655a283cc60c128 and project 49e317feb48548bba0745b2297130f5e. Resources: {'ram', 'cores', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 08:20:25.686546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 08:20:25.690049 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f3022867-49cb-466b-bdd3-ff18e5199e53',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 08:20:25.824008 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-48adf79e-8fa9-49cc-8f6f-fe2893bab578 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.971651 Jun 18 08:20:25.824651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 540/1065] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Jun 18 08:20:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 08:20:25.833113 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:25.833862 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=22 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:25.838431 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d95cb402-b526-47e3-977a-96170d862bcb tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:25.839151 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d95cb402-b526-47e3-977a-96170d862bcb tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:25.899058 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d95cb402-b526-47e3-977a-96170d862bcb tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:25.906103 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d95cb402-b526-47e3-977a-96170d862bcb tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1095 microversion: 2.1 time: 0.075020 Jun 18 08:20:25.906702 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 526/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:25 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:26.923902 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:26.924511 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:26.931315 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:26.931757 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:26.932514 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:26.932936 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:26.997472 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:27.006075 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-466a4c4c-e9c8-4478-94eb-8596abc2fb7b tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1211 microversion: 2.1 time: 0.086703 Jun 18 08:20:27.012536 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 541/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:26 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:28.023595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:28.024149 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:28.032798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:28.033558 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:28.034343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:28.034781 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:28.244245 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:28.252943 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-da79651d-33b7-4cbd-a622-08a4ba41c533 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.233247 Jun 18 08:20:28.253614 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 527/1068] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:28 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:28.308079 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-cb8c3d5f-e417-473f-b0fa-f6208d572d79 req-ec58b78c-505e-4137-818f-f698f3f7c053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6033480-d15b-45ea-98a4-c6ba90b4a934", "tag": "781bd2e5-d97e-47f3-a048-a7ed1940989a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:28.317788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-cb8c3d5f-e417-473f-b0fa-f6208d572d79 req-ec58b78c-505e-4137-818f-f698f3f7c053 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:28.318517 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-cb8c3d5f-e417-473f-b0fa-f6208d572d79 req-ec58b78c-505e-4137-818f-f698f3f7c053 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:28.342438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-cb8c3d5f-e417-473f-b0fa-f6208d572d79 req-ec58b78c-505e-4137-818f-f698f3f7c053 service nova] Creating event network-changed:781bd2e5-d97e-47f3-a048-a7ed1940989a for instance f6033480-d15b-45ea-98a4-c6ba90b4a934 on hv-cinder-82634 Jun 18 08:20:28.347742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-cb8c3d5f-e417-473f-b0fa-f6208d572d79 req-ec58b78c-505e-4137-818f-f698f3f7c053 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043477 Jun 18 08:20:28.348667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 542/1069] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:20:29.271201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:29.271762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:29.278729 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:29.279204 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:29.280094 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:29.280518 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:29.473832 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:29.481911 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33a7d45f-befb-47b8-a520-d8b0f481cc35 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.214642 Jun 18 08:20:29.482696 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 528/1070] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:29 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:30.499872 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:30.500569 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:30.506942 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:30.507415 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:30.508163 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:30.508607 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:30.641677 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:30.649408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fce4ba04-3d5e-4b95-890a-5152fc4ed40d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.154345 Jun 18 08:20:30.649975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 543/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:30 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:31.670624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:31.671835 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:31.683388 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:31.684153 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:31.685424 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:31.686151 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:31.829808 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:31.838097 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb70ab0f-1bfe-459c-a63e-4ef42a3cecf6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.174156 Jun 18 08:20:31.838680 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 529/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:31 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:32.861131 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:32.862327 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:32.873081 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:32.873546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:32.874655 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:32.875117 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:33.021765 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:33.029363 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d8013eee-b798-44e8-a8d9-b858323a2855 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.177423 Jun 18 08:20:33.029926 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 544/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:32 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:34.047290 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:34.047912 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:34.055088 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:34.055526 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:34.056279 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:34.056709 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:34.189246 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:34.202166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db517462-93e1-4373-965d-e55b57d309bd tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.158614 Jun 18 08:20:34.202927 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 530/1074] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:34 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:35.227178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:35.228125 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:35.236302 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:35.236741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:35.237502 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:35.237929 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:35.371583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:35.379175 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1bad056-c6b6-4e74-af6f-fca6397b5e48 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.158566 Jun 18 08:20:35.379721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 545/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:35 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:36.400218 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:36.401265 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:36.404430 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:36.410249 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:36.410719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:36.411574 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:36.412033 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:36.832342 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:36.840301 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-390ffda5-d4c8-4e61-abb8-9a84ecbfd5c8 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.446599 Jun 18 08:20:36.840872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 531/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:36 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:37.662789 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-8f10a63b-771e-4979-91be-6cc00ee4549f req-cdf0bd49-9783-478a-a704-d55c195e34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6033480-d15b-45ea-98a4-c6ba90b4a934", "name": "network-vif-plugged", "status": "completed", "tag": "781bd2e5-d97e-47f3-a048-a7ed1940989a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:37.666452 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:37.667269 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:37.674896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8f10a63b-771e-4979-91be-6cc00ee4549f req-cdf0bd49-9783-478a-a704-d55c195e34f5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:37.675357 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8f10a63b-771e-4979-91be-6cc00ee4549f req-cdf0bd49-9783-478a-a704-d55c195e34f5 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:37.688681 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-8f10a63b-771e-4979-91be-6cc00ee4549f req-cdf0bd49-9783-478a-a704-d55c195e34f5 service nova] Creating event network-vif-plugged:781bd2e5-d97e-47f3-a048-a7ed1940989a for instance f6033480-d15b-45ea-98a4-c6ba90b4a934 on hv-cinder-82634 Jun 18 08:20:37.693766 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-8f10a63b-771e-4979-91be-6cc00ee4549f req-cdf0bd49-9783-478a-a704-d55c195e34f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034951 Jun 18 08:20:37.694409 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 546/1077] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:20:37.856949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:37.857581 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:37.864270 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:37.864719 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:37.865480 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:37.865910 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:38.061394 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:38.068970 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bcfc686d-cd78-4d8d-8f5e-4e60fe9b0e27 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1266 microversion: 2.1 time: 0.215963 Jun 18 08:20:38.069531 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 532/1078] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:37 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:39.087350 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:39.088083 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:39.094518 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:39.095104 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:39.096136 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:39.096598 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:39.237185 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:39.244968 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3820f27d-d9da-40a4-9703-e9652e158497 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1454 microversion: 2.1 time: 0.162821 Jun 18 08:20:39.245583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 547/1079] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:39 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:39.267307 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:39.267954 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:39.274839 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:39.275294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:39.276062 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:39.276499 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:39.416363 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:39.427481 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7466efb4-699b-459a-9704-3350578ae595 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1454 microversion: 2.1 time: 0.164136 Jun 18 08:20:39.428707 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 533/1080] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:39 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:41.007596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-ab5d958e-b91f-4aba-998d-c9ad7f76696b req-8b70e41e-b19a-4b4e-9dc0-15a396cd5b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6033480-d15b-45ea-98a4-c6ba90b4a934", "tag": "781bd2e5-d97e-47f3-a048-a7ed1940989a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:41.016368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ab5d958e-b91f-4aba-998d-c9ad7f76696b req-8b70e41e-b19a-4b4e-9dc0-15a396cd5b90 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:41.017033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ab5d958e-b91f-4aba-998d-c9ad7f76696b req-8b70e41e-b19a-4b4e-9dc0-15a396cd5b90 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:41.027901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-ab5d958e-b91f-4aba-998d-c9ad7f76696b req-8b70e41e-b19a-4b4e-9dc0-15a396cd5b90 service nova] Creating event network-changed:781bd2e5-d97e-47f3-a048-a7ed1940989a for instance f6033480-d15b-45ea-98a4-c6ba90b4a934 on hv-cinder-82634 Jun 18 08:20:41.033031 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-ab5d958e-b91f-4aba-998d-c9ad7f76696b req-8b70e41e-b19a-4b4e-9dc0-15a396cd5b90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029480 Jun 18 08:20:41.033673 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 548/1081] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:20:44.168229 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:44.169263 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:44.176649 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:44.177101 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:44.177853 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:44.178280 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:44.201418 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lazy-loading 'flavor' on Instance uuid d83cfa51-3868-46f1-9835-b4e7f01da932 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 08:20:44.279309 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44f0e378-afd6-45bf-a4bd-31d1a519b7f2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "POST /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932/action" status: 202 len: 0 microversion: 2.1 time: 0.117632 Jun 18 08:20:44.279876 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 534/1082] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:20:44 2022] POST /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:20:44.289263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:44.289960 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:44.296248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:44.296903 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:44.297801 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:44.298214 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:44.435249 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:44.446852 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0595afc9-4612-4358-a4d6-cb4d21a2a369 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.161813 Jun 18 08:20:44.447641 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 549/1083] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:44 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:45.473937 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:45.475106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:45.485467 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:45.486198 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:45.487487 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:45.488206 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:45.633233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:45.643769 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-72ec2bce-649e-4511-8efb-03d12cf61d1f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.179023 Jun 18 08:20:45.644349 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 535/1084] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:45 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:46.665178 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:46.666161 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:46.675944 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:46.676390 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:46.677175 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:46.677601 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:46.819040 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:46.830862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6e87a32e-a461-438d-aeaf-1e2afee76f62 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.171996 Jun 18 08:20:46.831770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 550/1085] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:46 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:47.851872 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:47.852728 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:47.862909 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:47.863397 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:47.864163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:47.864595 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:47.997642 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:48.005831 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-83451c2f-7ea7-4add-8cb6-ca1d6bf8a6c9 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.160809 Jun 18 08:20:48.006404 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 536/1086] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:47 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:49.022770 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:49.023535 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:49.030240 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:49.030662 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:49.031449 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:49.031856 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:49.164962 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:49.173204 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ecf76b34-f6b7-4bd9-a342-52efe5bfe29c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.154458 Jun 18 08:20:49.173760 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 551/1087] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:49 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:50.194753 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:50.195866 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:50.206251 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:50.206699 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:50.207491 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:50.207930 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:50.346294 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:50.354186 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-adf466f0-4a26-4ccc-8688-d5fec5be165f tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.165970 Jun 18 08:20:50.354807 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 537/1088] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:50 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:51.375665 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:51.376749 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:51.384187 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:51.384686 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:51.385526 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:51.386004 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:51.519961 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:51.527758 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26c229a8-b98e-4671-9643-04cc99b4e4d1 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.158719 Jun 18 08:20:51.528300 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 552/1089] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:51 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:52.548981 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:52.550178 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:52.558097 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:52.558578 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:52.559385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:52.559818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:52.696706 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:52.704746 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-118148b7-6ab7-4054-a67d-0143d3bf8f1c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.162328 Jun 18 08:20:52.705330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 538/1090] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:52 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:53.725956 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:53.726930 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:53.737862 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:53.738602 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:53.739901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:53.740671 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:53.880159 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:53.891876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ba83e367-6478-4420-9627-9afe289566ad tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.172202 Jun 18 08:20:53.892864 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 553/1091] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:53 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:54.910023 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:54.910624 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:54.917648 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:54.918122 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:54.918890 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:54.919373 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:55.128338 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:55.136665 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9df6daec-2490-4405-ad70-9bed105a7376 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.230542 Jun 18 08:20:55.137233 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 539/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:54 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:56.158099 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:56.159239 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:56.162837 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:56.171865 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:56.172604 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:56.173886 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:56.174600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:56.179542 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=69 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:56.322391 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:56.330583 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c9bafb72-1578-47f5-9d7a-915557bd565a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.179208 Jun 18 08:20:56.331183 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 554/1093] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:56 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:57.348500 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:57.349085 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:57.351692 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=31 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:57.357354 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.357821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.358575 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.359027 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.361818 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:20:57.494182 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:57.501811 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b0489b86-a356-47b0-8824-40aa52d45df2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1568 microversion: 2.1 time: 0.157484 Jun 18 08:20:57.502385 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 540/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:57 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:57.521074 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:57.521640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:57.529149 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.529649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.530359 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.530785 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.626282 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9d7e45cc-78e6-4ffa-81cb-0835e73c0e6a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "POST /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932/action" status: 202 len: 0 microversion: 2.1 time: 0.111627 Jun 18 08:20:57.626937 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 555/1095] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Jun 18 08:20:57 2022] POST /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:20:57.636106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:57.636717 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:57.643292 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.643737 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.644498 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:57.645137 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:57.787556 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:57.795693 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-beb2083f-56f8-4c5f-bf91-18c2ff634362 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1576 microversion: 2.1 time: 0.164328 Jun 18 08:20:57.796276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 541/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:57 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:58.814790 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:58.815368 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:20:58.821871 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:58.822317 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:58.823110 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:58.823541 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:58.967324 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:20:58.975274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-63a7f9bc-6e3c-4d94-b6e6-c8eb772654e8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1518 microversion: 2.1 time: 0.165047 Jun 18 08:20:58.975868 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 556/1097] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:58 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:20:59.720427 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-74fbc381-cd5d-4582-a226-2c3c3b814c56 req-ea90e94d-dee3-49cd-b680-8f91aae07138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "name": "network-vif-unplugged", "status": "completed", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:20:59.730592 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-74fbc381-cd5d-4582-a226-2c3c3b814c56 req-ea90e94d-dee3-49cd-b680-8f91aae07138 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:20:59.731476 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-74fbc381-cd5d-4582-a226-2c3c3b814c56 req-ea90e94d-dee3-49cd-b680-8f91aae07138 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:20:59.747366 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-74fbc381-cd5d-4582-a226-2c3c3b814c56 req-ea90e94d-dee3-49cd-b680-8f91aae07138 service nova] Creating event network-vif-unplugged:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:20:59.752933 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-74fbc381-cd5d-4582-a226-2c3c3b814c56 req-ea90e94d-dee3-49cd-b680-8f91aae07138 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036268 Jun 18 08:20:59.753741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 542/1098] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:20:59.993600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:20:59.994365 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:00.001663 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:00.002103 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:00.002883 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:00.003333 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:00.134658 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:00.142656 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9464eeb4-1c41-48ba-b993-e8663686ef94 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.153113 Jun 18 08:21:00.143262 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 557/1099] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:20:59 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:01.164045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:01.165111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:01.173905 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:01.174448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:01.175456 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:01.176002 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:01.330221 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:01.340723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f080013-5b09-4d35-84c4-dbcfa7b695be tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.183436 Jun 18 08:21:01.341721 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 543/1100] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:01 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:02.362500 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:02.363512 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:02.374596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:02.375396 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:02.376640 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:02.377393 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:02.519341 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:02.531069 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85da056f-6c94-4b24-9a13-e86b3d20f350 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.174750 Jun 18 08:21:02.531975 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 558/1101] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:02 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:03.555323 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:03.555864 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:03.563052 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:03.563519 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:03.564281 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:03.564710 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:03.709012 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:03.717127 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-650d5853-247e-402d-a3e2-209cf464a52c tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.168744 Jun 18 08:21:03.717697 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 544/1102] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:03 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:04.733994 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:04.734608 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:04.744319 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:04.744781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:04.745758 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:04.746292 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:04.890023 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:04.898245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-524dfa82-efdc-4562-9161-5c02fafbe95a tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.168195 Jun 18 08:21:04.898824 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 559/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:04 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:05.919520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:05.920486 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:05.931296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:05.931737 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:05.932504 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:05.932932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:06.070402 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:06.078743 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a9d780b4-dc27-4d90-bcc6-2f7bebbb9c51 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.165716 Jun 18 08:21:06.079448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 545/1104] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:05 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:07.102438 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:07.103199 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:07.111587 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:07.112142 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:07.113090 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:07.113626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:07.261667 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:07.273420 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6a179bb2-67ea-412c-914c-27ad68e9f1dd tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1574 microversion: 2.1 time: 0.177171 Jun 18 08:21:07.274109 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 560/1105] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:07 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:08.295886 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:21:08.296534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:21:08.303631 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:08.304443 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:08.305587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:08.306343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:08.444600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:21:08.452529 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-24a00b7d-5278-407a-b3ca-b3fa58a04431 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1561 microversion: 2.1 time: 0.160646 Jun 18 08:21:08.453080 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 546/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:21:08 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:21:09.858189 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e898bd24-d8e9-481c-8fde-11b876c46c69 req-13503a4f-7cd9-4cab-923a-9ec8d3c40d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "name": "network-vif-plugged", "status": "completed", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:21:09.866959 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e898bd24-d8e9-481c-8fde-11b876c46c69 req-13503a4f-7cd9-4cab-923a-9ec8d3c40d09 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:21:09.867408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e898bd24-d8e9-481c-8fde-11b876c46c69 req-13503a4f-7cd9-4cab-923a-9ec8d3c40d09 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:21:09.878417 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e898bd24-d8e9-481c-8fde-11b876c46c69 req-13503a4f-7cd9-4cab-923a-9ec8d3c40d09 service nova] Creating event network-vif-plugged:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:21:09.883616 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e898bd24-d8e9-481c-8fde-11b876c46c69 req-13503a4f-7cd9-4cab-923a-9ec8d3c40d09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029007 Jun 18 08:21:09.884196 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 561/1107] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:13.119646 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa2a76cf-b3fa-46ba-8caa-aa1a2d34e192] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 08:22:13.123340 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=17 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:22:13.124198 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:22:13.130787 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-b0b10221-5b34-4067-a7eb-cd7787de71ed req-a9aaf1ed-074d-4c06-9af7-4cf05fa86ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6033480-d15b-45ea-98a4-c6ba90b4a934", "tag": "781bd2e5-d97e-47f3-a048-a7ed1940989a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:13.140330 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:13.140733 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b0b10221-5b34-4067-a7eb-cd7787de71ed req-a9aaf1ed-074d-4c06-9af7-4cf05fa86ee6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:13.141111 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:13.141248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-b0b10221-5b34-4067-a7eb-cd7787de71ed req-a9aaf1ed-074d-4c06-9af7-4cf05fa86ee6 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:13.143240 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=13 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:22:13.144070 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=37 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 08:22:13.151508 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:13.152224 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:13.153267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:13.153419 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-b0b10221-5b34-4067-a7eb-cd7787de71ed req-a9aaf1ed-074d-4c06-9af7-4cf05fa86ee6 service nova] Creating event network-changed:781bd2e5-d97e-47f3-a048-a7ed1940989a for instance f6033480-d15b-45ea-98a4-c6ba90b4a934 on hv-cinder-82634 Jun 18 08:22:13.153982 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:13.158896 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-b0b10221-5b34-4067-a7eb-cd7787de71ed req-a9aaf1ed-074d-4c06-9af7-4cf05fa86ee6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037449 Jun 18 08:22:13.159588 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 562/1108] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:13.180031 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:22:13.268032 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-89a9e91b-6605-436d-bee7-1fbc83a9d115 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 204 len: 0 microversion: 2.1 time: 0.148832 Jun 18 08:22:13.272267 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 547/1109] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:22:13 2022] DELETE /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:22:13.278263 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:13.278966 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:13.285298 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:13.285742 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:13.286506 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:13.286971 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:13.500532 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:13.508225 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-17eb35bb-b66e-4d47-b0ee-2f735870f79d tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1578 microversion: 2.1 time: 0.234133 Jun 18 08:22:13.508828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 563/1110] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:13 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:14.530607 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:14.531343 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:14.539564 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:14.540013 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:14.540798 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:14.541232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:14.559106 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa2a76cf-b3fa-46ba-8caa-aa1a2d34e192] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34176. Jun 18 08:22:14.780280 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:14.788565 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-62b5248a-220b-41c6-983b-7fe6e0018cd3 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1578 microversion: 2.1 time: 0.264720 Jun 18 08:22:14.789130 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 548/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:14 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:15.808172 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:15.808774 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:15.815902 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-3662945d-15cf-45d2-b018-2c817a879ce9 req-bd2ee8f2-f6bf-49d9-a73a-7db997be2920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6033480-d15b-45ea-98a4-c6ba90b4a934", "name": "network-vif-deleted", "tag": "781bd2e5-d97e-47f3-a048-a7ed1940989a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:15.816820 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:15.817373 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:15.818270 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:15.818826 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:15.825762 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3662945d-15cf-45d2-b018-2c817a879ce9 req-bd2ee8f2-f6bf-49d9-a73a-7db997be2920 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:15.826202 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3662945d-15cf-45d2-b018-2c817a879ce9 req-bd2ee8f2-f6bf-49d9-a73a-7db997be2920 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:15.840138 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-3662945d-15cf-45d2-b018-2c817a879ce9 req-bd2ee8f2-f6bf-49d9-a73a-7db997be2920 service nova] Creating event network-vif-deleted:781bd2e5-d97e-47f3-a048-a7ed1940989a for instance f6033480-d15b-45ea-98a4-c6ba90b4a934 on hv-cinder-82634 Jun 18 08:22:15.845471 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-3662945d-15cf-45d2-b018-2c817a879ce9 req-bd2ee8f2-f6bf-49d9-a73a-7db997be2920 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Jun 18 08:22:15.846422 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 549/1112] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:15.884223 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:15.892248 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bcdff966-dbe4-4393-a638-629da545d0e5 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 200 len: 1393 microversion: 2.1 time: 0.088346 Jun 18 08:22:15.892814 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 564/1113] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:15 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 1393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:16.910359 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:16.911089 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: f6033480-d15b-45ea-98a4-c6ba90b4a934] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:16.918082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:16.918534 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:16.919337 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:16.919768 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:16.934318 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] HTTP exception thrown: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Request method failure captured: Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 HTTP/1.1 Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYmsl764ch1c3OSgs0tmqoWXHnNzQB-Cz6HPzzhizW7K1R3PP_nDYIYe1-HmDyULxi_ovpE7OBTFZ2hBFnRe1xdcGAlno5dbyQnMmPjABE5MKu0z7X5Blyu24oQermtelge4xV0hvrsus0Ks7s-9FFj9pHwMKxGvkIEp06f38_ET4qQ Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:22:16.935979 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49e317feb48548bba0745b2297130f5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49e317feb48548bba0745b2297130f5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 1e35908c10cc4627a655a283cc60c128 Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. Jun 18 08:22:16.937844 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'f6033480-d15b-45ea-98a4-c6ba90b4a934'} Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:22:16.938681 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. Jun 18 08:22:16.940082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:16.941340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Returning 404 to user: Instance f6033480-d15b-45ea-98a4-c6ba90b4a934 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:22:16.941340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1a89e95a-7af9-4325-97a2-77ff7119e880 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934" status: 404 len: 111 microversion: 2.1 time: 0.031917 Jun 18 08:22:16.941340 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 550/1114] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:16 2022] GET /compute/v2.1/servers/f6033480-d15b-45ea-98a4-c6ba90b4a934 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:22:20.305685 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:20.306245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:20.308191 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-337b737f-7148-4436-b7be-32e423b76931 req-6f7f31da-821e-4a00-b3c5-0d74e91359ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5573a143-a4e9-442f-99ed-0abd0d5cadcc", "tag": "e4b5e076-5761-45c9-96b4-5ee38ce31514"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:20.313022 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:20.313505 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:20.314245 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:20.314738 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:20.317634 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-337b737f-7148-4436-b7be-32e423b76931 req-6f7f31da-821e-4a00-b3c5-0d74e91359ae service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:20.318327 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-337b737f-7148-4436-b7be-32e423b76931 req-6f7f31da-821e-4a00-b3c5-0d74e91359ae service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:20.330102 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-337b737f-7148-4436-b7be-32e423b76931 req-6f7f31da-821e-4a00-b3c5-0d74e91359ae service nova] Creating event network-changed:e4b5e076-5761-45c9-96b4-5ee38ce31514 for instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc on hv-cinder-82634 Jun 18 08:22:20.336082 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-337b737f-7148-4436-b7be-32e423b76931 req-6f7f31da-821e-4a00-b3c5-0d74e91359ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 Jun 18 08:22:20.337129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 551/1115] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:20.342561 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:22:20.429026 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-95414121-5d20-4404-8832-d53887d427bf tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 204 len: 0 microversion: 2.1 time: 0.127559 Jun 18 08:22:20.431100 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 565/1116] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:22:20 2022] DELETE /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:22:20.440436 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:20.441129 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:20.448061 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:20.448511 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:20.449284 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:20.449718 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:20.582437 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:20.590161 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cdc55394-9518-4961-b41d-81fe224883c9 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1578 microversion: 2.1 time: 0.155303 Jun 18 08:22:20.590723 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 552/1117] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:20 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:21.609626 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:21.610649 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:21.617274 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:21.617721 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:21.618488 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:21.618921 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:21.757815 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:21.769024 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-024911be-85d0-4572-a2bb-46fb9d231145 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1578 microversion: 2.1 time: 0.164843 Jun 18 08:22:21.769568 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 566/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:21 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:22.710421 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2b37140d-91f7-452d-8430-9cfd93ba7232 req-161efa0b-288e-4038-9e9c-60e50a7f3225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5573a143-a4e9-442f-99ed-0abd0d5cadcc", "name": "network-vif-deleted", "tag": "e4b5e076-5761-45c9-96b4-5ee38ce31514"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:22.719790 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2b37140d-91f7-452d-8430-9cfd93ba7232 req-161efa0b-288e-4038-9e9c-60e50a7f3225 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:22.720223 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2b37140d-91f7-452d-8430-9cfd93ba7232 req-161efa0b-288e-4038-9e9c-60e50a7f3225 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:22.732159 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2b37140d-91f7-452d-8430-9cfd93ba7232 req-161efa0b-288e-4038-9e9c-60e50a7f3225 service nova] Creating event network-vif-deleted:e4b5e076-5761-45c9-96b4-5ee38ce31514 for instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc on hv-cinder-82634 Jun 18 08:22:22.737587 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2b37140d-91f7-452d-8430-9cfd93ba7232 req-161efa0b-288e-4038-9e9c-60e50a7f3225 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Jun 18 08:22:22.738673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 553/1119] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:22.785788 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:22.786388 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:22.793038 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:22.793479 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:22.794236 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:22.794657 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:22.861309 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e35908c10cc4627a655a283cc60c128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e317feb48548bba0745b2297130f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:22.869546 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-58eb6128-0176-4769-8db4-5eb6800c8ab6 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 200 len: 1226 microversion: 2.1 time: 0.087660 Jun 18 08:22:22.870116 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 567/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:22 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:23.892484 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:23.893371 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: 5573a143-a4e9-442f-99ed-0abd0d5cadcc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:23.901646 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:23.902205 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:23.903201 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:23.903741 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:23.920917 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] HTTP exception thrown: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Request method failure captured: Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc HTTP/1.1 Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYmsl764ch1c3OSgs0tmqoWXHnNzQB-Cz6HPzzhizW7K1R3PP_nDYIYe1-HmDyULxi_ovpE7OBTFZ2hBFnRe1xdcGAlno5dbyQnMmPjABE5MKu0z7X5Blyu24oQermtelge4xV0hvrsus0Ks7s-9FFj9pHwMKxGvkIEp06f38_ET4qQ Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:22:23.923045 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49e317feb48548bba0745b2297130f5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49e317feb48548bba0745b2297130f5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 1e35908c10cc4627a655a283cc60c128 Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. Jun 18 08:22:23.924732 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': '5573a143-a4e9-442f-99ed-0abd0d5cadcc'} Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:22:23.925676 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. Jun 18 08:22:23.927296 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:23.928683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Returning 404 to user: Instance 5573a143-a4e9-442f-99ed-0abd0d5cadcc could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:22:23.928683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b17be20d-8d04-4cb9-b2fc-27413a95596e tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc" status: 404 len: 111 microversion: 2.1 time: 0.039876 Jun 18 08:22:23.928683 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 554/1121] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:23 2022] GET /compute/v2.1/servers/5573a143-a4e9-442f-99ed-0abd0d5cadcc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:22:24.367596 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:24.368175 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:24.374973 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.375454 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.376325 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.376762 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.393113 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] HTTP exception thrown: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Request method failure captured: Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 HTTP/1.1 Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYmsl764ch1c3OSgs0tmqoWXHnNzQB-Cz6HPzzhizW7K1R3PP_nDYIYe1-HmDyULxi_ovpE7OBTFZ2hBFnRe1xdcGAlno5dbyQnMmPjABE5MKu0z7X5Blyu24oQermtelge4xV0hvrsus0Ks7s-9FFj9pHwMKxGvkIEp06f38_ET4qQ Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:22:24.394768 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49e317feb48548bba0745b2297130f5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49e317feb48548bba0745b2297130f5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 1e35908c10cc4627a655a283cc60c128 Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.396495 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'c23eed6b-7d92-400e-8d81-f35aa47e0577'} Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:22:24.397450 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.400426 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.402195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Returning 404 to user: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:22:24.402195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7dbe0e83-2ff2-447c-bad4-61c3d192f837 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 404 len: 111 microversion: 2.1 time: 0.032595 Jun 18 08:22:24.402195 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 568/1122] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:22:24 2022] DELETE /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:22:24.404840 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:24.405414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] [instance: c23eed6b-7d92-400e-8d81-f35aa47e0577] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:24.411616 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.412060 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.412850 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.413282 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.428913 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] HTTP exception thrown: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Request method failure captured: Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 HTTP/1.1 Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept: application/json Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Connection: close Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Length: 0 Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Content-Type: application/json Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Host: 10.222.0.23 Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABirYmsl764ch1c3OSgs0tmqoWXHnNzQB-Cz6HPzzhizW7K1R3PP_nDYIYe1-HmDyULxi_ovpE7OBTFZ2hBFnRe1xdcGAlno5dbyQnMmPjABE5MKu0z7X5Blyu24oQermtelge4xV0hvrsus0Ks7s-9FFj9pHwMKxGvkIEp06f38_ET4qQ Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Role: reader,member Jun 18 08:22:24.430821 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49e317feb48548bba0745b2297130f5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49e317feb48548bba0745b2297130f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49e317feb48548bba0745b2297130f5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 49e317feb48548bba0745b2297130f5e Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1434439605 Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Id: 1e35908c10cc4627a655a283cc60c128 Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-1434439605-project Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: method: > Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: exception: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.432567 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: action_args: {'id': 'c23eed6b-7d92-400e-8d81-f35aa47e0577'} Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:22:24.433414 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. Jun 18 08:22:24.434674 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Jun 18 08:22:24.436118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Returning 404 to user: Instance c23eed6b-7d92-400e-8d81-f35aa47e0577 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:22:24.436118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9283bd1f-a215-48ef-9b8b-362249b206f1 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577" status: 404 len: 111 microversion: 2.1 time: 0.031319 Jun 18 08:22:24.436118 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 555/1123] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:24 2022] GET /compute/v2.1/servers/c23eed6b-7d92-400e-8d81-f35aa47e0577 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:22:24.867676 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:24.868167 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:24.874876 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.875313 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.876334 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.877094 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.903743 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 08:22:24.932515 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-86adf791-dadb-41af-9886-b338b9d6df16 req-516477cc-236a-451e-8385-2689d1e0a805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:24.941664 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-86adf791-dadb-41af-9886-b338b9d6df16 req-516477cc-236a-451e-8385-2689d1e0a805 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:24.942166 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-86adf791-dadb-41af-9886-b338b9d6df16 req-516477cc-236a-451e-8385-2689d1e0a805 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:24.954391 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-86adf791-dadb-41af-9886-b338b9d6df16 req-516477cc-236a-451e-8385-2689d1e0a805 service nova] Creating event network-changed:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:22:24.960055 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-86adf791-dadb-41af-9886-b338b9d6df16 req-516477cc-236a-451e-8385-2689d1e0a805 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097846 Jun 18 08:22:24.960673 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 556/1124] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 08:22:24.985706 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6a2a1937-5c83-49b9-aaaf-952ea88af24e tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 204 len: 0 microversion: 2.1 time: 0.126619 Jun 18 08:22:24.986297 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 569/1125] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Jun 18 08:22:24 2022] DELETE /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 08:22:24.995180 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:24.995877 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:25.002708 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:25.003196 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:25.004010 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:25.004549 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:25.148846 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:25.156851 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21938beb-d66a-4060-8160-7cc0742277a2 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.165853 Jun 18 08:22:25.157466 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 557/1126] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:24 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:25.750071 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5e1c4c23-7ecc-4fe4-814c-72f013cd5652 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] Calling method '.version_select at 0x7f3be5145700>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:25.778408 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5e1c4c23-7ecc-4fe4-814c-72f013cd5652 tempest-TestVolumeBootPattern-1434439605 tempest-TestVolumeBootPattern-1434439605-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1725692452" status: 202 len: 0 microversion: 2.1 time: 0.032474 Jun 18 08:22:25.779005 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 570/1127] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Jun 18 08:22:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1725692452 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:22:26.174715 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:26.175766 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:26.182800 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:26.183276 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:26.184050 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:26.184475 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:26.319448 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:26.328600 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cab9fea-ee4a-41a7-b43b-4211935f36d8 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1567 microversion: 2.1 time: 0.157963 Jun 18 08:22:26.329520 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 558/1128] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:26 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:27.217072 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-491cfa24-fdd0-48a4-8384-4ef014165d93 req-b31cc003-2d0d-4ca7-ad1c-4e9ef211a467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d83cfa51-3868-46f1-9835-b4e7f01da932", "name": "network-vif-deleted", "tag": "57e98b0f-c23a-4686-a3c7-070c30fb690d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 08:22:27.227828 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-491cfa24-fdd0-48a4-8384-4ef014165d93 req-b31cc003-2d0d-4ca7-ad1c-4e9ef211a467 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:27.228217 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-491cfa24-fdd0-48a4-8384-4ef014165d93 req-b31cc003-2d0d-4ca7-ad1c-4e9ef211a467 service nova] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:27.240029 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-491cfa24-fdd0-48a4-8384-4ef014165d93 req-b31cc003-2d0d-4ca7-ad1c-4e9ef211a467 service nova] Creating event network-vif-deleted:57e98b0f-c23a-4686-a3c7-070c30fb690d for instance d83cfa51-3868-46f1-9835-b4e7f01da932 on hv-cinder-82634 Jun 18 08:22:27.245291 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-491cfa24-fdd0-48a4-8384-4ef014165d93 req-b31cc003-2d0d-4ca7-ad1c-4e9ef211a467 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Jun 18 08:22:27.245901 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 571/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Jun 18 08:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 08:22:27.346163 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:27.346949 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:27.353582 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:27.354026 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:27.354782 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:27.355236 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:27.417938 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d68eee466d948acbe1b74bb45dc3c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6902aa20d9248c7aa91d2559e5cabb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 08:22:27.426319 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8851783b-214e-4494-8ab0-87b349165166 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 200 len: 1218 microversion: 2.1 time: 0.084232 Jun 18 08:22:27.426825 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 559/1130] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:27 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 08:22:28.444271 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:28.445067 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] [instance: d83cfa51-3868-46f1-9835-b4e7f01da932] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 08:22:28.454879 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:28.455714 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:28.456555 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 08:22:28.457042 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Lock "45c5db4e-158a-4a75-9b44-9638d16c22a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 08:22:28.471287 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] HTTP exception thrown: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Request method failure captured: Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 HTTP/1.1 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept: application/json Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Connection: close Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Length: 0 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Content-Type: application/json Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Host: 10.222.0.23 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABirYo9i33RtjoWDspgy1Ondu4WK-qwbBSPvrG1h0tBkgReR-2kY4kswIrJofHpHSGQWxsXcw-5O1m6WAoGhTBL9ZdRPgv_KmcMwj_GcKyxgo67ctEShYjVP1Ze-hOMOTwXPaT-1_OmCkcr2Jmsh5ywoESF0gYLFdIothlDUJEL6rThbRo Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Id: b6902aa20d9248c7aa91d2559e5cabb6 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestShelveInstance-1914513266 Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Role: reader,member Jun 18 08:22:28.473033 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6902aa20d9248c7aa91d2559e5cabb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6902aa20d9248c7aa91d2559e5cabb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6902aa20d9248c7aa91d2559e5cabb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6902aa20d9248c7aa91d2559e5cabb6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestShelveInstance-1914513266 Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b6902aa20d9248c7aa91d2559e5cabb6 Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestShelveInstance-1914513266 Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User: tempest-TestShelveInstance-1914513266-project Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Id: 7d68eee466d948acbe1b74bb45dc3c19 Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestShelveInstance-1914513266-project Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: method: > Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: exception: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. Jun 18 08:22:28.474781 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: action_args: {'id': 'd83cfa51-3868-46f1-9835-b4e7f01da932'} Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 08:22:28.475741 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. Jun 18 08:22:28.477311 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Jun 18 08:22:28.478600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Returning 404 to user: Instance d83cfa51-3868-46f1-9835-b4e7f01da932 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 08:22:28.478600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dcc79c00-abbe-405b-bc54-ac001fc209e7 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932" status: 404 len: 111 microversion: 2.1 time: 0.035304 Jun 18 08:22:28.478600 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 572/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Jun 18 08:22:28 2022] GET /compute/v2.1/servers/d83cfa51-3868-46f1-9835-b4e7f01da932 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 08:22:28.656406 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8be437da-35a2-480f-a25c-a5342d6cfd14 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] Calling method '.version_select at 0x7f3be4522b80>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 08:22:28.683232 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8be437da-35a2-480f-a25c-a5342d6cfd14 tempest-TestShelveInstance-1914513266 tempest-TestShelveInstance-1914513266-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-847615162" status: 202 len: 0 microversion: 2.1 time: 0.030584 Jun 18 08:22:28.683826 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 560/1132] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Jun 18 08:22:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-847615162 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 08:23:41.997059 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:23:41.998003 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Sat Jun 18 08:23:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:23:48.183932 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:23:48.184900 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Sat Jun 18 08:23:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:25:22.409608 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:25:22.410921 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Sat Jun 18 08:25:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:25:23.268982 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:25:23.269643 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Sat Jun 18 08:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:25:42.597651 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:25:42.598573 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Sat Jun 18 08:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:27:02.010845 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:27:02.012028 dv-cinder-826349-2-iscsi devstack@n-api.service[117615]: Sat Jun 18 08:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:27:08.195824 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:27:08.196704 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Sat Jun 18 08:27:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 08:27:26.851455 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 08:27:26.852744 dv-cinder-826349-2-iscsi devstack@n-api.service[117616]: Sat Jun 18 08:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!